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Abstract 

This  report,  the  first  of  a  three-part  series,  presents  preliminary  results  in  a  study  on  the 
role  of  the  active  observer  in  the  hand/eye  coordination  problem. 

It  was  shown  in  [11]  that  the  hand/eye  coordination  problem  can  be  represented,  for  a  given 
pose  of  the  observer,  by  the  singularities  of  a  surface,  the  PCS.  Small  changes  in  the  pose  of  the 
observer  generally  produce  smooth  deformations  of  the  PCS.  There  are  configurations,  however, 
from  which  arbitrarily  small  modifications  of  the  point  of  view  result  in  profound  changes  in 
the  topological  nature  of  the  PCS.  This  paper  studies  these  bifurcation  configurations  and, 
furthermore,  investigates  the  possibihty  of  determining  a  priori  displacements  of  the  observer 
that  can  achieve  a  desired  effect  on  the  PCS  such  as  simphfying  its  topology  or  reducing  the 
number  of  singularities  separating  the  current  configuration  from  a  goal  to  be  reached. 

The  result  of  this  analysis  takes  the  form  of  the  “family  portrait”  of  all  possible  aspects  of 
the  PCS,  indexed  by  the  geometry  of  the  manipulator  and  the  pose  of  the  observer  relative  to  it. 
A  hand/eye  system  is  then  completely  coordinated — has  “learned  its  PCS” — when  a  “portrait” 
has  been  matched  with  the  experimental  data  gathered  by  the  low-level  controller  [3]. 
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N00014-93- 1-0257,  and  the  National  Science  Foundation,  under  a  Presidential  Young  Investigator  Award 
(Grant  IRI-90-57934). 
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1.  Introduction 


1.1  Active  vision 

This  report,  which  presents  preliminary  investigations  of  the  effects  and  uses  of  observer 
displacements  in  the  hand/eye  coordination  problem,  is  part  of  a  broader  study  of  active 
vision  and  of  the  role  of  the  active  observer  engaged  in  a  particular  task.  What  are  “good” 
activities  for  the  observer,  what  are  desirable  effects  of  these  activities,  and  how  can  they 
be  achieved,  both  purely  in  terms  of  the  perceptual  process  and  in  the  context  of  the  task 
at  hand?  How  is  active  vision  related  to  the  learning  problem?  These  are  some  of  the 
problems  that  I  would  like  to  address.  But  maybe  I  should  begin  by  making  a  small  point 
of  denominational  orthodoxy  and,  backed  up  by  early  writ  on  the  topic,  discuss  what 
is  and  is  not  active  vision,  and  where  the  present  work — hopefully — fits  into  the  whole 
scheme. 

We  can  observe  that  “when  humans  see  and  understand,  they  actively  look,  their 
eyes  converge  or  diverge,  they  adjust  to  the  level  of  illumination  and  they  move  their 
head”  [2].  We  can  establish  lists  of  possible  actions  (eye  and  head  movements,  vergence, 
focusing,  changing  the  position,  orientation,  or  nature  of  light  sources,  etc.).  We  can  even 
study — independently  or  in  conjunction — the  effects  of  such  actions  on  the  measurements 
or  results  of  various  perceptual  modules.  But  psychologists  have  not  waited  for  computer 
vision  researchers  to  point  out  the  beneficial  effects  of  head  and  eye  movements,  for 
example  on  reaching  tasks  [20].  Even  in  computer  vision,  most  studies  stressing  the 
importance  of  the  observer’s  position  and  orientation  relative  to  the  scene  and  to  the 
light  sources  were  in  fact  undertaken  long  before  the  introduction  of  active  vision  as 
a  research  topic  [‘Gibso50,Hom77,Marr82’].  It  was  also  well  established  by  then  that 
information  about  the  scene  could  be  extracted  from  the  optical  flow  resulting  from  the 
observer’s  displacements  [6].  So  is  active  vision  just  a  new,  catchy  name  for  old  ideas? 

The  answer  is  naturally  negative:  active  vision  is  not  the  subfield  of  computer  vision 
that  deals  with  the  case  of  a  mobile  observer  that  can  zoom,  focus,  or  control  its  vergence. 
Computing  the  optical  flow  is  not  an  active  vision  task.  Neither  is  visual  tracking  for  its 
own  sake.  On  the  other  hand,  choosing  the  observer’s  motion  parameters  so  as  to  reduce 
the  ambiguity  of  the  optical  flow  (and  hence  make  its  interpretation  easier),  or  tracking 
an  object  specifically  in  order  to  facilitate  its  recognition,  are  (would  be?)  active  vision 
problems.  Active  vision  is  concerned  with  “[manipulating]  the  constraints  underlying  the 
observed  phenomena  in  order  to  improve  the  quality  of  the  perceptual  results”  [1]. 

To  this  day,  one  can  essentially  distinguish  four  main  types  of  “active  vision” : 


The  first  kind,  which  I  will  call  hardware-based,  for  lack  of  a  better  nomenclature™ 
is  best  represented  by  the  work  of  E.  Krotkov  on  vergence  and  focusing  [16].  In  this- 
case,  there  is  a  direct  relation  between  a  physical  parameter,  or  set  of  parameters,  of 
the  visual  apparatus  and  measurements  made  about  the  scene.  The  problem  of  the 
active  observer  is  then  to  adjust  these  parameters  or  their  variations  so  as  to  get,  say,- 
the  best  overall  focus  on  some  part  of  the  image. 


Neither  problem  being  any  less  worthy  for  this  simple  reason,  needless  to  say, 
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•  Another  type  of  active  vision  is  concerned  with  the  choice  of  displacements  for  the 
observer  that  make  the  (quantitative)  visual  reconstruction  modules  perform  better. 
We  know  from  earlier  work  that  some  motions  of  the  observer  can  make  an  ill-posed 
problem  become  well  posed  [1].  But  it  is  also  possible  to  determine  a  priori  what 
motion  would  optimize  the  stability  of  reconstruction  computations  [10]. 

•  It  is  also  possible  to  choose  a  displacement  of  the  observer  so  as  to  facilitate  the 
understanding  of  the  scene.  For  example,  the  displacement  can  be  chosen  so  that  new 
faces  and  vertices  become  visible  in  the  case  of  a  polyhedral  world  [21]  or  so  as  to 
facilitate  the  reconstruction  of  simple  smooth  shapes  [17]. 

•  Finally,  the  last  type  of  active  vision,  of  which  the  present  work  is  to  our  knowledge  the 
first  representative,  addresses  the  problem  of  choosing  activities  of  the  observer  that 
facilitate  the  performance  of  the  perceptual  process  in  the  execution  of  a  particular 
navigation  task;  obstacle  avoidance,  prey  catching,  or — in  the  case  of  this  paper — 
hand/eye  coordination. 

1.2  Hand/eye  coordination:  background 

1.2.1  Position-based  vs.  image-based  methods 

We  are  interested  here  in  the  hand/eye  coordination  problem,  that  is,  in  the  visual  control 
of  a  robot  manipulator  in  hand  positioning  tasks,  a  problem  that,  when  referring  to 
humans,  is  also  sometimes  called  “reaching”  in  the  psychology  literature.  In  particular, 
we  will  not  be  addressing  here  the  problem  of  fine  motion  of  the  fingers,  not  because  this 
is  not  an  interesting  issue,  but  because  it  is  highly  unlikely  that  it  can  be  performed  based 
solely  on  visual  information:  At  least  during  the  learning  stage,  some  tactile  information 
must  be  used.  Our  goal  here  is  therefore,  using  only  visual  information,  to  be  able 
to  position  the  manipulator’s  end-effector  in  the  immediate  vicinity  of  any  visible  and 
accessible  object  in  the  environment. 

In  the  computer  vision  community,  hand/eye  coordination  has  generally  been  treated 
as  a  particular  case  of  the  calibration  or  pose  estimation  problem:  once  the  pose  of 
the  camera,  the  manipulator,  and  the  target  object  relative  to  each  other  have  been 
determined,  a  classical,  sensorless  trajectory  could  then  be  planned  that  performs  the 
positioning  task. 

That  pose  estimation  process,  however,  is  not  necessary,  as  [30]  demonstrated  in  the 
case  of  a  3-dof  eye-in-hand  system  (Figure  1(a)).  This  work  showed  in  particular  that,  for 
a  variety  of  visual  feedbacks  and  after  proper  calibration  of  the  system,  hand  positioning 
tasks  can  be  performed  by  applying  to  the  manipulator’s  joints  an  image-based  visual 
servoing  (IBVS)  control,  which  does  not  require  the  computation  of  any  3D  information. 
This  work  was  later  refined  in  [29]  and  extended  to  higher  degree  of  mobility  manipulators 
by  [5],  which  further  confirmed  the  strength  of  image-based  methods. 

^  It  is  clear  by  now  that  this  statement  of  the  problem  is  unduly  optimistic,  as  it  makes  the  pose 
estimation  problem  seem  almost  trivial.  Even  the  most  sophisticated  calibration  techniques  available 
today  do  not  provide  precise  enough  estimates  for  a  path  to  be  generated  once  and  for  aJJ.  Several 
iterations  of  the  pose  estimation/path  planning/motion  process  (or  static,  position-based  look-and-move 
control,  to  follow  the  nomenclature  of  [25])  are  necessary,  as  the  authors  themselves  point  out  [27]. 
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(a)  (b) 

Figure  1  —  Hand/eye  configurations:  (a)  Eye  in  hand  (b)  Eye  looking  at  hand. 

In  this  new  approach,  the  object  of  study  of  the  perceptual  module  is  no  longer  an 
n-tuple  of  coordinates  in  Cartesian  space,  but  the  Perceptual  Kinematic  Map  (or  PKM), 
/c,  which  directly  maps  the  Joint  Space  J  to  the  Camera  Space  [26],  or  space  of  measured 
image  features,  C.  There  remains  the  problem  of  initial  calibration,  which,  although 
not  as  crucial  as  with  the  look-and-move  type  of  control,  is  computed  through  a  long  and 
complicated  process  and — so  far — practically  requires  an  eye-in-hand  configuration  for  the 
hand/eye  system.  Both  for  obvious  anthropomorphic  reasons  and  because  it  would  allow 
more  interesting  tasks  to  be  performed,  it  would  seem  preferable  to  have  a  mobile  camera 
looking  at  the  hand  (Figure  1(b))  and  to  be  able  to  learn  the  PKM  while  performing 
simple  arm  and  head  motions. 

1.2.2  Three  approaches  to  the  learning  problem 

One  way  of  addressing  this  learning  problem  is  to  feed  the  (applied)  joint  displacements 
and  the  resulting  (measured)  image  space  displacements  to  a  neural  network  or  an  as¬ 
sociative  memory.  This  approach  is  probably  best  represented  by  [24]  and  [23],  which 
present  a  real-time  implementation  in  the  case  of  an  eye-in-hand  industrial  system,  i.e. 
one  restricted  to  a  conveyor-belt  environment.  One  must  also  mention  the  paradoxical 
case  of  [22],  which,  while  deliberately  non-practical  (being  restricted  to  the  case  of  planar 
pendulums),  nevertheless  led  to  an  implementation  and  is  so  far  alone  in  having  addressed 
the  problem  of  obstacle  avoidance  (in  the  pendulum’s  plane). 

However,  as  is  generally  the  case  with  problems  that  we  know  how  to  model  mathemat¬ 
ically,  robotics  problems  in  particular,  it  is  not  really  clear  what  advantage  connectionist 
approaches^  offer  over  more  classical  adaptive  control  (or,  more  generally,  parameter  re¬ 
covery)  techniques  that  explicitly  exploit  the  model  of  the  problem.  For  example,  [26] 
studies,  for  some  cases  of  the  camera  looking  at  the  hand,  the  analytic  form  of  the  PKM, 
in  which  only  the  coefficients  are  unknown,  since  they  depend  on  the  pose  of  the  camera. 

^  As  learning  techniques,  and  not  as  implementation  techniques. 
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The  hand/eye  coordination  problem  is  then  reduced  to  a  parameter  recovery  problem  and 
it  can  be  solved  by  observing  movements  of  the  hand  and  a  simple  best-fit  minimization 
procedure. 

In  many  ways,  the  approach  we  proposed  in  [11]  can  be  seen  as  a  geometrical,  quali¬ 
tative  counterpart  to  the  analytical,  quantitative  method  of  [26].  In  this  earlier  paper,  we 
showed  that,  for  a  given  pose  of  the  camera,  the  PKM  can  be  represented  by  a  hypersur¬ 
face  called  the  Perceptual  Control  Surface,  or  PCS,  whose  shape  is  defined  qualitatively 
by  the  location  and  type  of  its  singularities,  as  shown  in  Figure  2.  The  singularities  of 
the  PCS  are  detected  and  identified  during  the  execution  of  simple  hand  positioning  tasks 
that  can  be  performed  before  the  shape  of  the  surface  is  known,  for  example  by  applying 
the  kind  of  low-level  image-based  control  described  in  [12]. 


Figure  2  —  (a)  A  Perceptual  Control  Surface  (PCS);  (b)  Its  singularities. 


1.3  The  reduced,  “arm”  PCS 

We  proposed  in  [11]  to  study  the  PCS  of  the  complete  6-dof  PKM,  which  we  planned  to 
learn  based  on  information  gathered,  in  the  course  of  simple  point-to-point  displacement 
tasks,  by  the  basic  controller  sketched  out  in  [12].  In  fact,  all  versions  of  our  controller, 
from  this  early  version  to  the  full-fledged  simulation  and  implementation  presented  in  [3] 
have  so  far  performed  hand  positioning  tasks  by  simultaneously  activating  all  the  joints 
of  the  manipulator.  We  did  so,  primarily,  because  we  were  deliberately  trying  to  keep 
the  controller  simple.  At  the  time,  it  seemed  more  important  to  understand  the  basic 
properties  and  drawbacks  of  this  type  of  control  than  try  to  optimize  it.  In  particular, 
for  proper  functioning  of  the  Kalman  filter  that  we  use,  no  joint  should  stay  inactive  for 
more  than  a  few  steps. 

Although,  as  our  system  demonstrated,  it  is  possible  to  control  all  joints  together 
during  the  entire  course  of  the  trajectory,  there  are  several  reasons  to  prefer  separating 
the  control  of  the  “arm”  and  “wrist”  joints.  The  simple  (approximative)  geometrical  jus- 
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tification  “arm=position,  wrist =orientation”  is  not  as  compelling  in  the  case  of  a  visually 
guided,  manipulator  as  it  is  in  classical,  “sensorless”  robotics:  the  difference  between  po¬ 
sition  and  orientation  that  is  so  clear  in  the  Cartesian  space  appears  somewhat  blurred 
in  the  image  space.  Of  more  direct  application  to  the  PCS-based  approach  that  we  have 
chosen  here,  it  is  obvious  that  the  PCS  of  the  3-dof  arm  is  much  simpler  to  study  and 
model  than  that  of  the  whole  6-dof  manipulator. 

The  last,  and  probably  most  compelling  reason  is  that  the  results  gathered  by  psychol¬ 
ogists  and  physiologists  clearly  show  that  humans  (who  are  as  good  a  model  for  flexible, 
vision-guided  systems  as  we  are  likely  to  encounter)  effectively  separate  arm  movements 
from  wrist  movements.  Vince  [28]  showed  that  the  response  curve  for  fast  hand  move¬ 
ments  is  a  symmetrical  sigmoid  curve  (Figure  3(a)).  Movements  precisely  aimed  at  a 
target  still  produce  a  sigmoidal  response  curve,  but  the  curve  is  no  longer  symmetrical;  it 
instead  displays  a  prolonged  deceleration,  an  extended  homing-in  phase  (Figure  3(b)). 


Figure  3  —  Trajectories  of  aimed  movements:  (a)  fast  movement,  (b)  precise  movement. 

If  the  speed  of  the  movement  is  increased,  then  the  curve  finally  merges  with  the  one 
measured  for  fast  trajectories  performed  with  the  eyes  closed,  probably  because  visual  pro¬ 
cesses  are  too  slow  to  provide  useful  information.  Welford  [31]  argued  that  fast  movements 
were  ballistic,  that  is,  programmed  in  advance  and  run  without  correction  (this  requires 
the  existence  of  an  internal  representation  of  the  movement  or  motor  program).  Similarly, 
he  suggested  that  the  initial  phase  of  precise  hand  movement  is  ballistic,  while  the  slower 
homing-in  phase  is  performed  under  visual  control.  These  observations  are  further  refined 
by  the  work  of  Jeannerod  on  prehension.  [15]  distinguishes  between  arm  transport  and 
manipulation  components.  “The  important  point  is  that  in  mature  reaching  there  appears 
to  be  temporal  coordination  between  the  transportation  and  manipulation  components. 
That  is,  finger  closure  is  temporally  coordinated  with  the  deceleration  breakpoint  of  arm 
transport”  [18]. 

We  can  interpret  these  results  in  terms  of  our  PCS-based  approach  as  follows:  We  can 
distinguish  between  arm  movements  that  can  eventually — after  the  corresponding  PCS 
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has  been  learned — be  performed  ballistically,  and  fine  wrist  movements  that  are  only 
applied  only  once  the  hand  is  close  to  its  target.  The  object  of  our  study,  of  which  this 
report  is  only  a  first  step,  is  the  learning  of  the  “arm”  PCS. 

We  will  deal  here  with  the  case  of  the  2D  pendulum  and  of  the  2-degree-of-mobility 
manipulator  shown  in  Figures  4(a)  and  4(b)  respectively.  First,  because  2-dof  robot 
arms  can  already  perform  interesting  tasks  that  we  may  want  to  control  visually,  such 
as  pointing  a  light  or  laser  beam  (or  paint  gun)  in  a  particular  direction.  Also,  because 
if  we  are  one  day  to  control  manipulation  tasks  in  obstacle-cluttered  workcells,  then  the 
trajectory  of  each  individual  link,  and  not  only  of  the  end-effector,  must  be  monitored 
and  controlled  as  well.  The  PKM  of  a  3-dof  manipulator  will  be  the  object  of  another 
report. 


Figure  4  —  (a)  Double  pendulum,  (b)  2-degree-of-mobility  manipulator. 


1.4  Presentation  of  the  Problem 

We  suggested  in  [11]  that,  since  displacements  of  the  camera  can  change  the  topology  of 
the  PCS,  the  pose  of  the  camera  could  (and  therefore  should)  be  chosen  so  as  to  result  in 
“good”  changes  in  the  topology  of  the  PCS.  For  example,  the  total  number  of  singularities 
could  be  reduced  or,  more  simply,  the  number  of  singularities  between  the  current  position 
and  the  goal. 

As  an  example,  let  us  consider  the  hand/eye  configuration  represented  in  Figure  5(a) 
and  the  corresponding  singularities,  drawn  in  the  joint  space  (Figure  5(b)).  We  notice 
that  it  is  impossible  to  plan  a  path  between  joint  configurations  qi  and  qj  that  does  not 
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cross  a  singularity.  It  is,  however,  sometimes  possible,  simply  by  changing  the  pose  of 
the  observer,  as  shown  in  Figure  5(c),  to  modify  the  topology  of  the  PCS  so  that  it  is  now 

We  should  emphasize  the  fact  that,  with  our  PKM-based  approach,  the  path  is  actually  planned  in 
the  image  space.  We  just  show  here  how  the  problem  appears  in  the  joint  space. 
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possible  to  plan  a  path  between  qi  and  qf  that  does  not  cross  a  singularity.  In  this  case, 
we  see  that  an  active  observer  can  improve  the  performance  of  the  low-level  controller. 


(b) 


(d) 


Figure  5  —  Effect  of  a  displacement  of  the  observer  on  the  geometry  of  singularities  of  the  PKM 


What  is  more  interesting  is  that  movements  of  the  observer  will  help  in  learning  the 
shape  of  the  PCS.  We  will  see  in  this  report  that  we  can  obtain  a  “family  portrait”  of 
the  possible  configurations  of  the  singularities,  that  is,  a  finite  set  of  2D  curves,  indexed 
by  the  position  of  the  camera  relative  to  the  manipulator.  The  learning  of  the  PCS  can 
therefore  be  guided  by  the  prior  recognition  of  a  particular  configuration  of  the  family 
portrait,  using  measurements  made  by  the  low-level  controller. 


®  Obviously,  only  “perceptual”  singularities  (see  Sections  3  and  4)  can  be  so  modified:  displacements 
of  the  observer  have  no  effect  on  kinematic  singularities. 


7 


2.  Model  and  Notation 

2.1  Kinematic  map 

We  follow  here  the  classical  formalism  for  the  derivation  of  an  n-degree-of-freedom  ma¬ 
nipulator’s  kinematic  map  [4],  which  associates  a  coordinate  system  with  each  link  of  the 
kinematic  chain.  The  links  being  numbered  to  Sn  (here  n  =  2),  from  the  base  to  the 
end  effector,  n  -f  1  corresponding  reference  frames  IZi  =  (Oj,  y,-,  ii)t=o,n  are  defined, 
so  that  the  state  of  joint  J,-  connecting  Si  to  Si-i  is  represented  by  its  four  Denavit- 
Hartenberg  parameters:  two  angles,  ai  and  6i,  and  two  distances,  ai  and  bi  (see  Figure  6). 
The  manipulator  is  calibrated  when  these  parameters  have  been  precisely  determined. 


One  of  the  D-H  parameters  is  the  joint  variable,  q^:  di  in  the  case  of  a  prismatic 
joint,  6i  in  the  case  of  a  revolute  joint,  which  is  the  one  that  we  are  concerned  with  here. 
Throughout  this  paper,  I  will  use  the  notation  Ci  =  cosgj.  Si  —  sin^f,  Cij  =  cos{qi  +  qj), 
and  Sij  =  sin(5j  +  qj).  The  homogeneous  transformation  matrix  between  TZi-i  and  TZi 
can  then  be  expressed  as  follows: 

—  cos  Q  j  Si 
cos  Q,  Ci 


a:+i  = 


a 

5, 

0 

0 


sm  a  I 

0 


sin  Q,-  Si 
—  sin  Qi'  Ci 
cos  Q  j 
0 


G  J  Cl 
Ci  I  S I 
di 
1 


(1) 


Since  we  are  only  treating  here  the  case  of  2-dof  manipulators,  it  is  sufficient  to  track  a 
point  M  that  is  attached  to  the  terminal  link  of  the  arm.  The  kinematic  map  k  then 

®  Although  the  nominal  values  of  the  D-H  parameters  are  given  by  the  manufacturer,  [13]  reports  that 
end-effector  positioning  errors  can  be  reduced  from  several  centimeters  to  a  few  millimeters  by  a  refined 
determination  of  the  parameters. 
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simply  maps  the  joint  vector  q  =  (91,92)'  to  the  Cartesian  coordinates  of  M  relative  to 
7^0,  Mq: 

k:J-^JC 


q  I — )■  Mo 

7 

If  we  assume  without  loss  of  generality  that  M  is  identified  with  O2  (the  origin  of  the 
terminal  link’s  coordinate  system  TZ2),  then  Mo  is  given  by  the  fourth  column  of  the 
global  transition  matrix  A®  =  A?  •  A2.  Since  we  are  only  interested  in  the  position  of 
M  and  not  in  the  orientation  of  S2,  the  kinematic  Jacobian  matrix  K  is  then  simply  the 
3x2  matrix  obtained  by  differentiating  Mo: 


K  = 


5Mo 
dq  • 


(2) 


2.2  Perceptual  Kinematic  Map 

The  PKM  is  a  mapping  between  the  joint  space  and  the  camera  space  that  maps  the  joint 
coordinates  to  a. vector  of  image  features.  In  the  case  we  are  considering  here,  this  vector 
will  be  the  image  coordinates  of  m,  the  projection  of  M  onto  the  image  plane. 

qi — >  m  =  {x,y)'. 


Let  K  =  {0,x,  y,  z)  be  the  coordinate  system  associated  with  the  camera.  The  coordinate 
vector  of  M  relative  to  71  is  M  =  (A,  YiZ)': 


(X\ 

Y 

■  Mo  +  To 

(3) 

[z) 

•  Mo  -  •  C, 

(4) 

where  is  the  3x3  Euler  rotation  matrix  of  angles  tj),  9,  and  (f),  To  is  the  coordinate 

vector  of  Oq  relative  to  IZ,  and  C  =  -E  •  To  =  (Ac,  Yc,  Zc)'  is  the  coordinate  vector  of 
the  camera’s  optical  center  relative  to  T^o- 

If  we  adopt  for  the  camera  the  classical  model  of  a  pinhole  of  focal  length  / ,  then  m 
is  obtained  from  M  by  a  perspective  projection:  m  =  //Z  •  M  and,  by  differentiating  m 
with  respect  to  the  joint  variables,  we  obtain 


5m 

dq 


5m  5M 

^ 

—  •  D  ■ 

—  ■  D  • 


5Mo 

5q 

•Kq, 


1  7  f  0  —X 

where  D  =  (  „  . 

\0  f  -y 


^  The  Denavit-Hartenberg  representation  leaves  the  choice  of  the  origin  0„  of  the  end-effector’s  coor¬ 
dinate  system  to  the  discretion  of  the  user.  The  location  of  On  is  generally  chosen  so  that  as  many  D-H 
parameters  as  possible  are  set  to  zero  in  the  case  of  the  sensorless  problem.  We  are  more  interested  here 
in  simplifying  the  expression  of  the  PKM. 
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The  Jacobian  matrix  of  the  PKM  is  therefore  the  product  of  the  “perceptual”  and  of  the 
kinematic  Jacobian  matrices: 


J  = 


-K  =  P-K. 


(5) 


2.3  Bifurcations 

We  will  be  studying  in  this  paper  the  bifurcations  of  singularities  of  the  PKM  under 
the  effect  of  observer  movements.  At  singularities,  the  Jacobian  matrix  J  does  not  have 
full  rank,  which  results  in  its  determinant  being  zero.  We  see  from  Equation  (5)  that 
J  —  det  J  is  a  function  of  the  joint  configuration,  parameterized  by  the  pose  of  the 
manipulator  relative  to  the  camera,  given  by  the  translation  vector  To  and  by  the  Euler 
angles  •!/>,  6,  and  (f).  We  regroup  these  pose  parameters  into  a  single  vector  p  so  that  the 
equation  of  our  bifurcation  problem  is 


J {q- To, ■ip,  0,(f))  =  J{q;p)  =  0.  (6) 

The  object  of  our  study  will  therefore  be  the  qualitative  changes  that  the  locus  of  solutions 
of  (6)  undergoes  as  p  varies  over  El®. 

Throughout  this  paper,  I  wall  use  the  notation,  classification,  and  methodology  of  [7], 
to  which  the  reader  is  invited  to  refer  when  the  minimalist  overview  given  in  Appendix  A 
does  not  suffice.  In  particular,  I  will  restrict  the  problem  to  the  case  of  one  state  variable 
and  one  bifurcation  parameter  and  treat  all  other  parameters  as  perturbation  parameters. 
Generally,  I  will  be  treating  the  second  joint  angle,  q2,  as  the  state  variable,  the  first  joint 
variable,  qi,  as  a  bifurcation  parameter,  and  the  components  of  the  pose  vector  p  as 
perturbation  parameters.  The  analysis  proceeds  as  follows: 

•  Localization  of  the  singularities  and  of  the  bifurcation  points.  In  particular,  we  want 
to  differentiate  between  perceptual  singularities,  wTich  are  susceptible  of  bifurcations 
under  observer  displacements,  and  kinematic  singularities,  w'hich  are  not. 

•  In  the  neighborhood  of  a  given  bifurcation  point,  and  for  different  values  of  the  pertur¬ 
bation  parameters,  generation  of  the  bifurcation  diagram  in  order  to  determine  likely 
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candidates  among  the  “family  portrait”  of  elementary  bifurcations  given  by  [7]. 

•  Proof  that  one  of  these  likely  candidates  is  the  correct  bifurcation  problem.  Once  this 
is  done,  the  complete  persistent  bifurcation  diagrams  can  be  given. 

•  Finally,  we  must  establish  the  correspondence  between  the  physical,  pose  parameters 
of  the  initial  bifurcation  problem  and  the  perturbation  parameters  of  the  correspond¬ 
ing  universal  unfolding.  Only  then  wull  we  know'  w'hich  topological  transformations 
are  actually  possible,  and  how  the  active  observer  can  achieve  them. 

®  This  step,  although  crucial,  is  not  discussed  here  since  it  is  little  more  than  a  way  to  facilitate  the 
identification  of  the  correct  normal  form.  Once  this  has  been  done,  and  the  equivalence  has  been  proved, 
the  partial,  experimental  results  collected  during  this  “exploration”  step  are  superseded  by  those  provided 
by  the  next  step. 
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As  we  shall  see  in  the  next  section,  the  PCS  of  a  2D  pendulum  is  a  rather  tame  topological 
creature,  studied  here  only  for  the  sake  of  completeness.  In  essence,  the  role  of  the 
observer  with  such  a  manipulator  could  be  summarized  as:  “Stay  out  of  the  way.”  On  the 
other  hand,  the  PCS  of  a  2-dof  manipulator  exhibits  a  surprisingly  complex  topological 
behavior,  depending  on  the  point  of  view  of  the  observer.  This  behavior  will  be  the  subject 
of  Sections  4  and  5. 


Figure  7  —  Hand/eye  coordination  with  a  2D  pendulum 


3.  Case  of  the  2D  Pendulum 

3.1  The  PKM  and  its  Jacobian  matrix 

Pendulums  are  planar  manipulators  whose  joints  are  all  parallel  to  each  other.  In  practice, 
a  2D  pendulum  configuration  can  be  constituted  by  links  ^i,  S2,  and  Sz  (and  joints  J2 
and  J3)  of  a  classical  manipulator  such  as  a  PUMA  560,  i.e.  by  keeping  the  waist  joint 
fixed.  Comparing  Figures  7  and  6,  we  see  that  di  =  d2  =  0  and  ai  =  02  =  0-  The 
kinematic  map  of  our  2D  pendulum  is  therefore 


AC  :  J  K, 

q  i — A  Mo  = 


Cl  +  02  C12  '' 

a\  Si  +  02  5'i2 

V  0  ; 
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3.2  Singularities 

Both  the  kinematic  Jacobian  matrix  and  the  perceptual  Jacobian  matrices  are  2x2 
square  matrices.  It  ensues  that  det  J  =  det(P  •  K)  =  detP  •  detK.  We  can  therefore 
study  independently  the  singularities  of  K  and  P. 

Singularities  of  K: 

—ai  Si  — 02812  —02Si2'\ 
ai  Cl  +  02  C12  0.2  C12  /  ’ 

After  trivial  simplifications,  we  get  det  K  =  oi  02  82-  Kinematic  singularities  are  therefore 
solely  encountered  for  92  =  0  or  92  =  (modulo  27r),  which  corresponds  to  configurations 
where  the  arm  is  completely  folded  or  completely  extended. 

Singularities  of  P: 

It  follows  from  (5)  that 

P  =  ^  ■  D  •  =»  det  P  =  ^  •  det  (d  •  . 

Although  the  factor  1/Z^  depends  on  all  the  variables  and  parameters  along  the  kinematic 
and  perceptual  chains,  it  does  not  affect  the  study  of  singularities  so  we  will  treat  it  as  a 
constant  from  now  on. 

C^C^.  -  S^CoS^.  -C^S^-S^CeC^  0\ 

—8^8^  +  C^CgCf  0 

SgS^  SgCi!.  0  j 

f  ■  {C^C^  -  St^CgS.^)  -  X  SgS^.  f  •  {-C^S^  -  S^CgC.^)  -  X  SgC^  \ 

f  ■  {S^C^  +  C^CgS^)  -  y  SgS^.  f  ■  i-S^S^,  +  C^CgC^)  -  y  SeC^  )  • 


D  E 


0  —X 

f  -y 


Most  terms  in  the  developed  form  of  det  P  cancel  out  and  we  obtain  the  following  simple 
form: 


det  P  = 


Z2 


(  S^Sg  \ 
—  C^Sg 
\  Cg  ) 


(7). 


The  rightmost  term  in  (7)  happens  to  be  the  normal  to  the  plane  of  the  manipulator.  We 
can  therefore  draw  the  following  conclusions: 

•  Ip  has  no  effect  on  perceptual  singularities.  This  result  should  not  be  surprising  since 
the  axis  of  this  rotation  is  perpendicular  to  the  plane  of  the  manipulator. 

•  A  joint  configuration  q  is  a  perceptual  singularity  of  the  PKM  if  and  only  if  line  Om 
lies  in  the  plane  of  the  manipulator.  In  other  words,  q  is  a  singular  joint  configuration 
if  and  only  if  the  camera’s  optical  center  lies  in  the  plane  of  the  manipulator. 

•  Further  analysis  reveals  that  the  rank  of  P  cannot  be  zero. 
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We  can  plot  the  PCS  and  its  singularities  using  the  same  graphic  trick  as  in  [11],  that  is, 
we  give  depth  to  the  surface  by  plotting  {x,qi,y)  as  a  function  of  qi  and  92  (see  [9]  for 
details  and  justifications).  Figure  8  shows  a  PCS  (the  same  as  in  Figure  2,  but  seen  from 
a  different  point  of  view)  and  its  singularities:  the  two  singular  curves  corresponding  to 
^2  =  0  and  q2  =  and  that  constitute  the  “skeleton”  of  the  PCS. 


Figure  8  —  (a)  The  singularities  of  the  PCS,  which  define  the  “skeleton  of  the  surface.” 
(b)  The  corresponding  PCS  itself. 


3.3  Bifurcations 

The  2D  pendulum  does  not  offer  much  to  the  observer  in  terms  of  possibilities  of  topologi¬ 
cally  interesting  actions.  On  the  one  hand,  there  are  two  kinematic  singularities  on  which 
camera  displacements  have  no  significant  topological  effects.  On  the  other  hand,  there  is 
one  particular  degenerate  plane,  that  of  the  pendulum  itself,  in  which  the  camera  s  optical 
center  simply  must  not  lie. 

The  observer  can  therefore  obtain  a  topological  modification  of  sorts  by  passing 
through  the  plane  of  the  pendulum.  As  we  see  in  Figure  9,  the  PCS  is  flattened  and 
the  displacements  of  m  occur  in  the  image  along  the  dark  straight  line  shown  in  Fig¬ 
ure  9(d). 

Any  displacement  of  the  observer  whose  projection’s  endpoint  lies  on  this  line  simply 
keeps  the  observer  in  a  degenerate  configuration.  Solely  in  terms  of  the  topology  of  the 
PCS,  i.e.  degenerate  vs.  non-degenerate,^  a  good  displacement  of  the  observer  is  therefore 
any  displacement  that  contains  a  component  normal  to  the  pendulum’s  plane. 

®  As  is  generally  the  case  with  methods  based  on  a  topological  analysis,  we  can  only  talk  of  good 
and  “bad”  displacements,  without  intermediate  graduations.  For  example,  the  results  presented  here  do 
not  allow  us  to  satisfactorily  answer  the  question:  Which  of  the  the  two  “good”  displacements  shown  in 
Figure  9(d)  is  better? 
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(a) 


(b) 


Figure  9  —  (a)  and  (b)  Different  views  of  a  degenerate  PCS.  (c)  Its  singularities,  (d)  The 
scene  in  the  camera  space. 

Figure  10  shows  the  transformation  of  the  PCS  as  the  optical  center  crosses  the 
pendulum’s  plane.  In  Figure  10(a),  we  can  see  the  trajectory  followed  by  the  observer, 
parallel  to  the  Z  axis  of  the  pendulum.  The  PCS  corresponding  to  Zc  >  0  is  shown  in 
Figure  10(b).  For  Zc  =  0,  the  observer  lies  in  the  plane  of  the  pendulum  and  we  get 
the  flat,  degenerate  PCS  (Figure  10(c)),  but  as  soon  as  that  plane  has  been  crossed,  the 
non-degenerate  PCS  is  observed  again  (Figure  10(d)).  Not  surprisingly,  however,  since 
the  pendulum  is  seen  from  the  other  side  of  its  plane  of  motion,  the  sign  of  the  torsion  of 
the  PCS  around  its  main  axis  has  changed. 
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(c)  (d)  (e) 

Figure  10  —  Changes  in  the  topology  of  the  PCS  as  the  observer  crosses  the  pendulum’s  plane 
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4.  Singularities  of  the  2-dof  (2R)  Manipulator 

4.1  Kinematic  Singularities 

4.1.1  The  D-H  parameters 

The  type  of  manipulator  we  are  considering  here  has  its  rotation  axes  perpendicular  to 
each  other,  which  corresponds  to  the  configuration  presented  by  the  first  two  joints,  Jo 
and  Ji  of  most  manipulators.  This  amounts  to  setting  the  D-H  parameters  ao,  Qi,  and  o.^ 
to  0,±7r/2,  and  0  respectively,  as  shown  in  Figure  11.  By  far  the  most  common  type  of 
industrial  manipulator  is  the  one  with  oj  =  0  and  do  ^  0.  Configurations  with  ai  =  J2  =  0 
are  generally  reserved  for  small  manipulators  such  as  the  Mitsubishi  Movemaster  II  arm 
on  which  we  happen  to  have  performed  our  experiments,  while  the  case  ^3  =  0,  ai  0  is 
rarely  encountered.  Finally,  ao  cannot  be  zero  for  this  type  of  manipulator  and  generally 
[02 1  ^  1^21  >  1^2!.  Since  02  ^  0,  we  could  therefore  use  it  as  a  unit  and  normalize 

all  the  parameters  but  we  will  simply  assume  from  now  on  that  it  is  strictly  positive. 

4.1.2  The  kinematic  map 

In  the  case  of  the  2R  2-dof  manipulator,  the  kinematic  map  k  maps  two  joint  coordinates 
to  the  three  Cartesian  coordinates  of  the  endpoint,  M,  relative  to  TZo: 


[R^ 


IR^ 


Mo  = 


The  homogeneous  transition  matrices  A,j  take  the  following  form: 


/Cl  0  -5i 

GlCl  ^ 

(C2 

-52 

0 

«2C2  \ 

5i  C 

Cl 

gi5i 

Ai  9  = 

52 

C2 

0 

CL2S2 

0  - 

1  1 

0 

0 

0 

1 

do 

V  0  c 

0 

1 

1  0 

0 

0 

1  / 

Aoi  = 


The  global  transition  matrix  is  then 


Ao2  = 


(  C1C2  —C1S2O  ~Si  a^Ci a2CiC2  —  d2Si\ 
S1C2  —S1S2  Cl  aiSi a2SiC2 d2Ci 

—S2  —C2  0  —0282 

V  0  0  0  1  / 


We  compute  the  kinematic  map’s  Jacobian  matrix,  following  (2): 


/  — GiFi  —  a2SiC2  —  JzC]  —a2CiS2  \ 
K  =  I  aiCi  -f-  a2CiC2  —  doSi  — 025152  1 
V  0  -G2C2  ) 


(8) 
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I  would  rather  not  give  up  the  ability  to  check  the  homogeneity  of  my  equations  by  posing  co  =  1. 
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Figure  11  —  Denavit-Hartenberg  parameters  for  a  2-dof  manipulator 

4.1.3  Kinematic  singularities 

Kinematic  singularities  are  configurations  (91,92)5  for  which  K  does  not  have  full  rank, 
that  is,  det  K  =  0.  From  the  lower  right  element  of  K  we  can  distinguish  (since,  as  we 
mentioned  earlier,  02  ^  0)  two  cases. 

•  Case  1:  (72  =  0.  Then  the  joint  configuration  is  singular  if  and  only  if 

-aiSi  —d2Ci  C\  _  _  ^ 

aiCi-d2Si  Si  ^ 

which,  cLS  we  mentioned,  is  true  for  most  manipulators. 

•  Case  2:  C2  ^  0.  Then  in  order  for  the  joint  configuration  to  be  singular,  the  elements 
on  the  left  column  of  K  must  be  zero; 

f  -fli*?!  —  (12S1C2  -  d2Ci  =  0 
1  aiCi  +  a2CiC2  —  d2Si  =  0, 
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Combining  both  equations,  we  obtain  d2  =  0,  which,  as  we  mentioned  earlier,  is  false 
for  most  industrial  manipulators,  but  true  for  our  Mitsubishi  Movemaster  II.  After 
substituting  in  (9),  we  get 

Si  ■  (oi  +  <22  C2)  =  Cl  ■  (ci  +  G2  C2)  =  0 

Since  Si  and  Ci  cannot  be  simultaneously  equal  to  zero,  we  must  therefore  have 
C2  =  cos  92  =  —ai/a2. 


In  conclusion: 

If  ui  =  0  (whether  6.2  is  null  or  not),  a  singularity  is  observed  for  92  =  ±7r/2  and  any 
value  of  91-  In  this  configuration,  the  Cartesian  motion  produced  by  the  two  joints  are 
locally  collinear  and  can  therefore  be  chosen  to  cancel  each  other  out. 

If  (^2  =  0,  a  singularity  is  observed  for  92  =  iarccos  (—01/02)  and  any  value  of  the  first 
joint  angle,  91.  In  this  configuration,  the  endpoint  lies  along  the  axis  of  the  first  joint, 
making  it  therefore — locally — reducing  the  manipulator  to  one  degree  of  freedom. 

4.2  Singularities  of  the  PKM 

Since,  as  in  the  case  of  the  2D  pendulum,  we  are  only  tracking  one  hand  point,  the 
perceptual  Jacobian  matrix  is  simply 

P  =  ^  ^ 

The  rank  of  J  =  P  •  K  is  less  than  2  if  and  only  if  there  exists  a  vector  u  6  IR^,  u  ^  0 
such  that  J-u  =  P-  K-  u  =  0.  In  other  words,  the  configuration  is  singular  if  and  only 
if  ImKnKerP  ^  {0}. 

Identification  of  KerP: 

Ker  P  =  {v  e  :  D  •  E  •  v  =  o}  . 

Since  E  is  an  orthogonal  matrix,  we  can  define  w  such  that  v  =  E^  •  w  =  E“^  •  w.  Then, 
D  ■  E  •  V  =  0  D  •  w  =  0  3:/€lR:w  =  i/-mor,  since  m  and  M  are  collinear, 

KerP  =  -E'-M  :  /i  €  R}.  (10) 

Identification  of  ImK:  From  (8),  we  see  that 

ImK  =  |q  ei  +  ;3e2  :  (a,/?)  G  R"| ,  (11) 


where  ei 


/  — ctiS'i  —  0.28182  —  d2Ci  \ 
0\Ci  +  ^2^102  —  d2Si 
0 


and,  since  02  7^  0,  62  = 


lCiS2\ 

S1S2  . 

V  ^2  ) 
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Singularities  of  tt: 

We  can  see  from  (10)  and  (11)  that  a  necessary  and  sufficient  condition  for  joint  configu¬ 
ration  q  =  (?i,?2)^  to  be  singular  is  that  det(ei,e2,E'  •  M)  =  0. 

It  turns  out  that  the  equations  are  simpler  if  the  six  camera  pose  parameters  are 
regrouped  into  the  three  coordinates  of  the  optical  center  relative  to  the  robot’s  base 
coordinate  system  TIq.  We  will  therefore  develop  M  in  our  equations  using  (4)  rather 
than  (3),  so  that 


’^'■^,64  •  M  =  Mo  —  C  — 


''aiC'i  -{■  a2C\C2  —  d2Si  —  Xc'^ 
a.\S\  -f  a2S\C2  +  d2Ci  —  Yc 
^  —0282  —  Zc  ) 


The  condition  for  the  existence  of  a  singularity  then  becomes 


—ai8i  —  025x52 

-d2Ci 

Cl  82 

aiCi  4-  02C'iC2  —  d28i  —  Xc 

oiCi  4-  a2CiC2  ■ 

-  d28\ 

8182 

ai8i  4-  0251(72  4-  d2Ci  —  Yc 

=  0, 

0 

C2 

—0282  —  Zc 

(12) 


which,  after  a  few  simplification  steps,  can  be  expressed  as  an  equation  in  terms  of  the 
first  joint  variable,  qi: 


aia2  +  (ai  +  ^2  +  <^2)  *^2  +  o,\ZcS2  +  0,10-201  +  a2ZcC2S‘^  -f 

{—aiXc  —  d2Yc)  C2  —  02XcC2^  •  Cl  -I-  (13) 

(— aii^  ■+■  d2Xc)  C2  ~  02lxC'2]  '81  =0, 


/5o  +  A  •  C-i  /32  •  =  0,  (14) 

where  the  jdi  are  functions  of  the  second  joint  variable  92  and  of  the  pose  vector  C: 

j^o(?2)  ~  0102  T  4"  O2  -{-  C2  +  OiZc82  T  0102^2  +  O2ZCC2821 
/dl(92)  =  (— OiXc  —  d2Yc)  C2  —  02XcC2, 

^2{q2)  =  (“Oil^  -f  d2Xc)  C2  —  02YcC2- 


4.2.1  Case  1:  if  /?i  ^  0  or  ^2  7^  0 

We  are  trying  to  find  a  solution  for  qi  as  a  function  of  q2  parameterized  by  p.  For  this 
purpose,  we  define 

Id  =  +  ^2  TO  =  -Idol^- 

There  are  now  two  cases: 

•  If  I70I  >  1,  there  is  no  solution  to  (14),  and  therefore  no  singularity. 

•  If  I70I  8:  I5  can  define  0  G  [0,27r[  such  that  cos0  =  (di/ ^  and  sin0  =  ^2/ Id- 
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Then,  (C'i,5'i)  •  =  70  and  the  solution  to  (14)  is  given  by  Figure  12: 

q\  =  ±arccos7o  —  6  ±  2A;7r,  k  £  N. 

We  can  already  observe  that  if  70  can  vary  on  a  neighborhood  of  1  (or  —1),  then  a 
bifurcation  will  be  observed  at  this  point  since  n(l“)  =  2,  n(l)  =  1,  and  n(l'^)  =  0.  We 
will  study  in  Appendix  B  whether  this  bifurcation  is  in  fact  defined  and  if  others  exist. 


Figure  12  —  Solution  for  +  /?|  5:^  0 


4.2.2  Case  2:  /?o  =  /?i  =  /52  =  0 

If  /?i  =  /?2  =  0,  then  by  factoring  out  C2  we  get 

f  C2  {diXc  +  0^2 Fc  +  0-2XcC2)  =  0 
I  C2  (aiFc  -  d2Xc  +  a2FcC2)  =  0, 
so  that  there  are  again  two  cases: 

•  If  C2  =  0,  then  using  /3o  =  0,  we  obtain  0102  +  a\ZcS2  =  0.  So,  if  ax  =  0,  we  find 
again  the  kinematic  singularity  we  studied  in  the  last  subsection.  On  the  other  hand, 
if  ax  7^  0,  then  there  is  a  perceptual  singularity  for  Zc  =  — a25'2,  i.e.  Zc  =  —02  if 
q2  =  7r/2  and  Zc  =  02  if  92  =  37r/2. 

•  If  C2  7^  0,  then 

f  GjAc  -f-  C?2Fc  "b  a2XcC2  —  0 

\  axYc  —  c?2Ac  a2^ 0^2  —  0. 

We  have  a  system  of  linear  equations  in  unknowns  Xc  and  Yc-  The  discriminant  of 
the  system  is 


D  —  (gi  "b  02^2)^  "b  do-  (13) 

—  If  D  =  0,  then  d2  0  and  C2  =  —01/02,  which  is  a  kinematic  singularity  (rarely 
encountered  since  general!}’  c?2  /  0)  that  we  have  already  studied  and  on  which 
camera  displacements  have  no  effect. 
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-  If  D  ^  0,  then  a  necessary  condition  for  the  existence  of  a  singularity  is  therefore 
that  Xc  =  Yc  =  0  (i.e.  the  observer  is  standing  along  the  first  joint’s  rotation 
axis).  In  this  case,  since  /3o  =  0,  we  must  have: 

GiCl2  d"  4"  d"  ^1)  ^2  d"  0102^*2  —  S2  {fil  d"  0,2C'^  Zq- 


*  li  S2  =  0,  then  (^2  =  ±1  =4>  2aiG2  =  ±  (of  +  +  dfj .  This  is  a  viewer- 

independent  condition  involving  only  the  D-H  parameters,  and  that  is  false 
for  all  manipulators  which  we  have  checked. 

*  If  52  7^  0  and  C2  =  -^1/^2,  the  condition  for  the  existence  of  a  singularity 
(^0  =  0)  cannot  be  satisfied  since  it  requires  ^2  =  0,  in  which  case  we  would 
have  T)  =  0,  which  contradicts  the  initial  hypothesis. 

*  If  52  0  and  C2  ^  -ai/02,  then  a  perceptual  singularity  is  observed  for 

G1G2  d”  d”  ^2  -|-  ^2^  C2  d"  0102^*2 
S2  (ai  d-  02(52) 


5.  Bifurcations  for  the  2-dof  (2R)  Manipulator 

5.1  Presentation  of  the  problem 

5.1.1  Choice  of  a  state  variable 

We  are  interested  in  the  effects  that  displacements  of  the  observer  may  have  on  the 
topology  of  the  PCS.  In  other  words,  we  are  trying  to  determine  the  effect  that  changes 
of  values  for  Xc^  Yc,  and  Zc  may  have  on  the  locus  of  solutions  (91,  92)  to  Equation  (13) 
that  we  studied  in  the  last  subsection. 

We  therefore  have  a  family  of  equations  with  two  variables  and  three  perturbation  pa¬ 
rameters: 


G{q\,q2'-,Xc-,Yc,Zc)  — 


0102  d-  (oj  -f  02  d-  ^2)  C2  d-  a\ZcS2  d-  aia2C2  d-  a2ZcC2S'^  d- 
J(— oiA'c  —  d2Yc)  C2  —  02X002]  ■  Cl  + 

(  — OiTc  d-  d2Xc)  C2  —  0‘2YcC2  •  5l 


=  0. 
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Throughout  this  paper,  we  will  use  a  capital  letter  to  refer  to  the  family  of  equations 
parameterized  by  the  pose  of  the  observer,  6^(91,92;?)  (resp.,  H{q2,qr,p)),  while  the 
corresponding  small  letter  name,  g{qi,q2)  (resp.  h{q2,qi)),  will  be  used  to  refer  to  a 
particular  element  of  this  family,  whenever  the  context  is  clear. 

The  mathematical  toolbox  most  appropriate  for  our  problem  is  the  theory  of  bifur¬ 
cations  [7],  of  which  we  give  a  rudimentary  overview  in  Appendix  A.  Since  we  only  have 
one  equation  to  relate  qi  and  $2,  one  of  these  two  variables  will  be  treated  as  the  state 
variable  and  the  other  as  the  bifurcation  parameter.  We  show  in  Appendix  B  that,  if  g 
and  its  first  two  partial  derivatives  with  respect  to  qi  are  null,  then  all  partial  derivatives 
of  arbitrarily  high  order  of  g  with  respect  to  qi  are  null  as  well. 

We  will  therefore  rather  study  here  what  happens  if  we  use  x  =  q2  as  the  state  variable 
and  A  =  as  the  bifurcation  parameter  and  we  decompose  the  study  into  cases  based  on 
the  Denavit-Hartenberg  parameters  aiand  d2.  This  means  that  we  study  the  bifurcations 
of  the  family  of  functions  H{x,X-,p)  =  H{q2,qi;p)  =  G{qi,q2;p). 

5.1.2  Notation 

In  order  to  facilitate  the  study  of  h(x,X)  =  h[q2,qi),  we  factor  it  so  as  to  separate  as 
much  as  possible  the  terms  that  depend  solely  on  qi  and  those  that  depend  on  92  ^ 


-  {ai  +  a2C2)  •  (A:3  (92)  -  C2  •  h  (qi))  +  ^26*2  •  h  (qi) , 


where  •  fci(?i)  =  d2  +  Xc  ■  Si  -  Yc  ■  Ci, 

•  k2iqi)  =  Xc-Ci  +  Yc-Su 

•  ^3(72)  ~  0,2  Ql  •  C2  Zc  •  S2- 

We  note  in  particular  that  k[{qi)  =  k2{qi),  k2{qi)  =  d2-ki{qi),  and  ^3(91)  =  a2-k3{q2). 

Another  important  property  of  our  problem  is  its  cylindrical  symmetry  with  respect 
to  the  first  joint  axis,  zq  (Figure  13(a)).  This  means  that  we  can  simplify  the  problem  by 
using  the  distance  between  the  observer  and  the  first  joint,  Rc  =  (Xc^  +  Yc^f-G,  rather 
than  coordinates  Xc  and  Yc,  as  long  as  we  use  a  relative  angle  to  represent  the  state  of 
the  the  first  joint.  Let  us  consider  Figure  13(b),  which  is  drawn  in  the  horizontal  plane  of 
the  manipulator’s  reference  frame  (that  is,  perpendicular  to  zq).  The  polar  coordinates  of 
the  observer’s  projection  onto  this  plane  are  therefore  {Rc,6c),  with  Xc  =  Rc  cos  Oc  and 
Yc  =  Rc  sin  Oc- 

Substituting  for  Xc  and  Yc  in  the  expressions  of  ki  and  k2,  we  obtain 

^1(91)  =  ^2  +  •  (cos  ■  sin  —  sin^c’cos^i) 

=  d2  +  Rc-  sin  (91  -  Oc) 

^2(91)  =  Rc  ■  {cos  Oc  ■  cos  qi  -f  sin  0c  •  sin  ) 

=  Rc  ■  cos  (91  -  Oc) . 
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Figure  13  —  (a)  Cylindrical  symmetry  of  the  problem,  (b)  Representation  in  the  horizontal 
plane  passing  through  the  origin  Oo- 


The  absolute  value  of  the  first  joint  angle  only  matters  in  terms  of  the  joint  travel, 
which  is  not  relevant  to  this  study.  We  can  therefore  assume  without  loss  of  generality 
that  Oc  =  0,^^  so  that  we  obtain 


k-i{qi)  =  d2  +  Rc- sin qi 
hiqi)  =  Rc- cos  qi. 

Since,  for  any  pair  of  real  numbers  {Ki,K2)  #  (0,0),  there  exists  a  unique  pair  of  real 
numbers,  {Rc,qi)  €  IR  x  [0,27r],  such  that  h{qi)  =  K\  and  ^2(91)  =  K2-,  we  can  treat 
ki{qi)  and  k2{qi)  as  the  unknowns  of  the  linear  equations  h  =  0  and  hx  =  0. 

5.1.3  Underlying  philosophy  of  the  approach 

The  underlying  philosophy  of  the  approach  we  are  following  here  is  that  of  the  theory 
of  singularities,  applied  to  the  study  of  bifurcation  problems  [7]  and  in  particular  to  the 
concept  of  an  organizing  center.  It  is  probably  best  to  reproduce  here  the  loose  description 
of  this  “very  suggestive,  but  somewhat  vague,”  term  (characteristics  shared  by  most  names 
coined  by  Rene  Thom)  proposed  by  Golubitsky  and  Schaeffer: 

“Consider  a  problem  which  exhibits  a  variety  of  quahtatively  different  behaviors, 
depending  on  various  parameters.  An  organizing  center  is  associated  with  the  distin¬ 
guished  set  of  values  for  the  parameters  such  that  all  (or  at  least  many)  of  the  different 
behaviors  occur  for  parameter  values  in  a  small  neighborhood  of  the  distinguished  val¬ 
ues.  Typically  at  an  organizing  center  the  system  exhibits  its  most  singular  behavior. 

[. . .]  In  particular,  quasi-global  results  may  often  be  obtained  by  the  application  of  local 
analysis  near  an  appropriately  chosen  organizing  center.” 

Alternatively,  we  could  pose  A51  =  3i  —  and  study  h{q2,Aqi),  but  this  leads  to  cumbersome 
formulas  for  the  derivatives  of  h. 
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The  various  parameters  of  the  system  can  therefore  be  treated  as  perturbation  terms  in 
the  neighborhood  of  the  organizing  center.  This  introduces  the  second  important  concept 
of  the  approach,  that  of  the  codimension  of  a  bifurcation  problem,  which  is  defined  to  be 
the  minimum  number  of  parameters  necessary  to  represent  all  possible  perturbations  of 
the  organizing  center,  up  to  smooth  {C°°)  equivalence. 

For  example,  only  two  parameters  suffice  to  represent  (up  to  smooth  equivalence) 
all  possible  perturbations  of  the  “pitchfork”  bifurcation  problem  -  Ax  =  0  in  the 
neighborhood  of  the  bifurcation  point  (xo,Ao)  =  (0,0).  Indeed,  for  any  function  g{x,X) 
smooth-equivalent  to  x^  —  Ax  in  a  neighborhood  of  (0,  0)  and  any  appropriately  small 
perturbation  term  p(x.  A),  there  exists  a  pair  {a, /3)  e  IR^  such  that  g{x,X)  +  p(x,A)  is 
smooth-equivalent  to  x^  -f  Ax  -f  a  -h  /?x^  in  a  neighborhood  of  (0,0).  In  other  words,  if 
n  is  the  codimension  of  the  bifurcation  problem  under  study,  it  is  sufficient  to  study  the 
perturbations  of  the  organizing  center  by  choosing  perturbations  in  a  set  kF  C  IR”  that 
is  often  of  finite,  small  dimension,  while  the  original  set  of  perturbation  functions  was  of 
infinite,  non-denumerable,  dimension. 

The  last  important  concept  of  the  approach  is  that  of  the  transition  set,  S,  of  a 
bifurcation  problem,  that  is,  of  the  subset  of  VF  C  IR”  composed  of  those  n-tuples  of 
perturbation  parameters  for  which  one  of  the  basic  elementary  phenomena — bifurcation, 
hysteresis,  and  double  limit  point  (see  details  in  Appendix  A  or  [7])— are  observed.  Except 
in  the  most  degenerate  cases  of  bifurcation  problems,  E  defines  a  segmentation  of  W  into 
connected  components  (typically,  for  a  bifurcation  problem  of  codimension  n,  S  is  a  set 
of  dimension  n  -  1,  for  example  a  set  of  planar  curves  when  =  IR^). 

We  now  have  defined  the  rudimentary  background  necessary  for  understanding  the 
main  theorem  of  the  approach  [7]: 

Main  geometric  theorem: 

Let  G  :  U  X  L  X  W  — >  IR  be  a  family  of  bifurcation  problems  satisfying 
G{x,  A;  a)  0  V(x,  A,  a)  6  dU  x  L  x  W. 

Let  a  and  fd  be  in  the  same  connected  component  of  W  S.  Then  G{  ■  ,  ■  ;  a) 

and  G{  ■  ,  ■  ;  ^)  are  globally  equivalent  on  U  x  L. 

Let  us  quote  from  [7]  one  last  time:  “In  other  words,  the  persistent  bifurcation  diagrams 
in  the  unfolding  G  are  enumerated  by  the  connected  components  of  W  ~  S.  A  priori  it 
is  possible  that  equivalent  diagrams  could  occur  in  two  different  components  of  IF  ~  S, 
but  we  have  not  found  any  example  where  this  actually  occurs.” 

Although  these  results  apply  regardless  of  the  codimension  of  the  bifurcation  problem, 
only  the  space  of  bifurcation  problems  of  codimension  <  3  has  been  completely  charted 
so  far.  An  obvious  reason  for  this  limit  is  that  the  complexity  of  topological  behavior 
increases  with  the  codimension  of  the  bifurcation.  Another  reason  is  that  a  geometric 
interpretation  of  the  results  becomes  almost  impossible  when  the  codimension  of  the 
bifurcation  (that  is,  the  dimension  of  W)  is  greater  than  3. 
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5.1.4  Application  to  the  singularities  of  the  PKM 

The  family  of  bifurcation  problems  that  we  are  studying  here  is  defined  by  the  condition 
for  the  nullity  of  the  Jacobian  J,  for  which  our  model  admits  four  parameters,  two  of 
which  are  active  (the  camera  pose  parameters,  Zc  and  i?c),  and  two  of  which  are  fixed 
(Denavit-Hartenberg  parameters  oi  and  ^2). 

Ideally,  we  would  like  to  study  the  organizing  center  for  this  general  system.  It  turns 
out,  unfortunately,  that  it  is  possible  to  pick  values  for  01,^2?  and  Rc  that  result  in  an 
organizing  center  of  very  high  codimension.  It  follows  that  our  study  of  the  bifurcations 
of  h{q2,q\)  must  be  decomposed  into  cases,  bcised  on  the  geometry  of  the  manipulator, 
that  is,  on  the  relative  values  of  its  Denavit-Hartenberg  01,02,  and  (Figure  14). 


A. *  cases: 

B. *  cases: 


A.*  cases: 


*.l  cases 
\a\\>a2 


*.l  cases: 
|ail>02 


*.2  cases: 

\a\\=a2 


*A  cases: 
«jsO 


*.2  cases: 

\a\\=a2 


Figure  14  —  Decomposition  into  cases,  bcised  on  the  geometry  of  the  manipulator 

For  some  cases  of  manipulator  geometry,  the  “disappearing”  organizing  center  will 
then  be  replaced  by  another,  simpler  organizing  center.  In  some  other  cases,  the  “dis¬ 
appearance”  of  the  underlying  organizing  center  will  result  in  the  emergence  of  several 
competing,  simpler  organizing  centers. 

In  order  to  illustrate  this  comment,  let  us  consider  the  case  of  a  system  whose  under- 
Iving  organizing  center  is  a  pitchfork  bifurcation  (see  Appendix  A),  but  for  which  only  one 
parameter  is  available  (through  the  model)  to  perturb  the  bifurcation  equation.  Let  us 
first  consider  the  simple  case  where  a  =  ai  ^  0  is  fixed  and  jd  is  the  parameter  that  can 
be  controlled.  In  other  words,  we  are  restricting  the  study  to  the  subset  {oi}  x  El  C  kF 
(Figure  15).  In  this  case,  as  jd  varies  from  ydi  io  ^2,  ^  modification  of  the  topology  of 
the  bifurcation  diagram  is  observed,  for  /d  =  fdo,  that  can  be  satisfactorily  explained  in 
terms  of  the  hysteresis  bifurcation  —  A  =  0.  In  this  case,  we  can  say  that  a  simpler 
organizing  center  has  “emerged”  once  the  “true”  organizing  center  had  been  removed. 
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Note,  however,  that  this  “emerging”  organizing  center  does  not  tell  us  anything  about 
the  parabolic  branch  of  the  bifurcation  diagram. 


Figure  15  —  A  simple  path  across  the  space  of  perturbations 


The  problem  is  much  more  complex  if  a  more  general  path  is  chosen.  Let  us  for 
example  consider  the  parametric  path  (of(^),  ^(<5))  across  W  shown  in  Figure  16.  This 
time,  as  6  varies  from  to  S2,  two  different  changes  can  be  observed,  which  can  be 
explained  separately  in  terms  of  the  hysteresis  bifurcation  —  A  =  0  and  of  the  simple 
bifurcation  —  A^  =  0.  It  is  clear  that  whatever  explanation  we  could  present,  based  on 
the  plots  obtained  as  6  varies,  would  not  provide  the  sort  of  global  view  of  the  problem 
(in  particular,  regarding  the  changes  observed  between  60  and  that  the  pitchfork 
organizing  center  does. 


Figure  16  —  A  more  complex  path  across  the  space  of  perturbations 


Sometimes,  recognizing  the  perturbed  bifurcation  diagrams  of  these  “emerging”  or¬ 
ganizing  centers  requires  some  practice.  A  reason  for  that  is  that  the  branches  of  the 
bifurcation  diagrams  then  rarely  continue  cleanly  to  infinity.  Instead,  separate  branches 
join  and  there  will  sometimes  be  another  bifurcation  to  consider  at  the  junction  point. 
Again,  both  bifurcations  would  be  explained  as  part  of  the  same  phenomenon  if  the  “true” 

Of  course,  the  actual  physical  parameters  accessible  to  the  experimenter  may  generate  any  kind  of 
path  in  W,  for  example  one  containing  several  loops  that  all  intersect  the  transition  set. 
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organizing  center  were  accessible  to  analysis.  Let  us  consider  for  example  the  bifurcation 
diagrams  shown  in  Figure  17.  All  correspond  to  perturbed  diagrams  of  the  pitchfork 
bifurcation  that  appear  as  a  part  of  the  winged  cusp  elementary  bifurcation  (codimen- 

Sion  d). 


Figure  17  —  Perturbed  forms  of  the  pitchfork  appearing  as  a  part  of  the  winged  cusp  bifurcation 

For  some  cases  of  manipulator  geometry,  the  bifurcation  problem  will  still  contain 
an  organizing  center  of  codimension  greater  than  3.  On  can  therefore  wonder  if  the 
displacements  of  the  observer  could  not  be  restricted  so  as  to  remain  in  the  neighborhood 
of  one  of  the  simpler  organizing  centers,  and  avoid  the  most  degenerate  ones.  This  sug¬ 
gestion  is  not  completely  groundless:  after  all,  with  most  practical  hand/eye  systems,  the 
observer  cannot  move  freely  with  respect  to  the  manipulator,  as  it  is  constrained  by  the 
mechanism  that  activates  it  (in  particular,  it  is  fairly  frequent  that  Zc  is  constrained  to  be 
positive,  as  in  the  case  of  the  human  hand/eye  system,  or  negative,  but  cannot  cross  the 
plane  Zc  =  0).  In  this  case,  we  might  be  able  to  describe  the  topological  changes  happen¬ 
ing  within  a  few  branches  of  the  bifurcation  diagram,  and  for  small  camera  displacements. 
We  would  still,  however,  be  unable  to  indicate  a  priori  what  the  other  branches  of  the 
bifurcation  diagram  may  look  like.  Even  if  we  we  plot  bifurcation  diagrams  for  a  very 
large  number  of  poses  of  the  camera,  we  would  be  unable  to  guarantee  that  we  have  not 
missed  some  local  phenomenon. 

5.1.5  Symmetry  and  periodicity  of  the  PKM 

We  notice  that  S2  and  Zc  appear  in  the  expression  of  H  only  when  multiplied  by  each  other 
so  that  H{q2,qi-,Zc,Rc)  =  H{-q2,qi-,-Zc,Rc)-  As  a  consequence,  we  can  restrict  our 
study  of  the  perturbed  bifurcations  of  h  to  the  half  of  the  perturbation  space  corresponding 
to  Zc  >  0,^^  knowing  that  the  topology  for  the  other  half  can  be  built  by  simple  symmetry. 

Since  qi  only  appears  in  the  expression  of  h  and  its  derivatives  in  terms  that  are 
multiplied  by  Rc  (i.e.  Rc  cos  qi  and  Rc  sin  qi),  setting  Rc  =  0  would  effectively  eliminate 

There  is  obviously  something  artificial  in  my  saying  “Let  us  imagine  we  knew  nothing  of  the  winged 
cusp  bifurcation  (resp.  pitchfork  bifurcation)  and  then  looked  at  this  diagram;  wouldn  t  it  be  hard  then 
to  figure  out  what  is  going  on?”  The  point  here  is  that,  for  some  geometries  of  manipulators  that  we 
will  have  to  study,  the  underlying  organizing  center  is  not  available  to  us,  since  it  is  deep  in  uncharted 
mathematical  territory. 

One  of  these  cases  will  produce  the  organizing  center  of  the  entire  system,  regardless  of  whether  the 
pose  of  the  camera  that  it  calls  for  is  actually  reachable  or  not:  For  many  cases  in  our  study  of  the  PKM, 
the  bifurcation  of  highest  codimension  is  obtained  when  Zc  —  0  and/or  Rc  —  0,  when  the  corresponding 
point  in  fact  belongs  to  the  physical  manipulator  itself,  and  cannot  therefore  be  reached  by  the  camera. 

Alternatively,  we  could  restrict  our  study  to  one  half  of  the  Joint  Space:  (92,91)  £  [Oj^r]  x  [0,27r[, 
which  leads  to  simpler  individual  cases,  but  a  more  complex  task  of  pasting  the  symmetric  halves  together. 
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the  first  joint  angle,  thus  resulting  in  a  very  degenerate  topology.  We  will  therefore  only 
consider  the  case  i2c  >  0  in  our  study. 

Finally,  we  should  mention  that,  since  we  ignore  here  the  constraints  imposed  by 
joint  travel,  all  branches  of  the  bifurcation  diagram  “wrap  around”  to  form  closed  curves 
anyway.  This  takes  care  of  the  the  non-nullity  condition  on  the  boundary  dU  x  L  x  W, 
since  U  is  in  fact  a  Jordan  curve  and  has  no  boundary  proper  {U  x  L  is  simply  a  torus). 

5.2  Manipulator  Geometry  Type  A.l:  d2^0  and  lajl  >02 

In  this  case,we  have  a  fairly  interesting  behavior  of  function  h,  with  no  less  than  four 
“emerging  organizing  centers,”  plus  a  simple  bifurcation  and  two  “type  0”  bifurcations 
that  are  connected  to — but  not  directly  related  to — some  of  these  centers. 

5.2.1  Identification  of  the  bifurcations 

Proposition  1: 


For  any  2-dof  manipulator  such  that  its  Denavit-Hartenberg  parameters  sat¬ 
isfy  <^2  ^  0  and  |ai|  >  ao,  there  exist  a  unique  triple  of  configurations  of  the 
hand/eye  system,  =  {x^- ,  Zc^_  ,  Rc^_),  =  (a:i+ ,  Ai+;  ,  i?c,+ ), 

and  7^2  =  (2:2, '^2;  ■^C2» 

//(x.  A;  Zc^_  ,  ),  in  a  neighborhood  of  (xj- ,  Aj- ), 

Zc^^iRc^j^),  in  a  neighborhood  of  (xi+,Ai+),  and 
H{x,X]  Zc2,Rc2)i  in  a  neighborhood  of  (x2,A2), 
are  all  equivalent  to  the  quartic  fold  bifurcation  (type  7): 

-f  ^A  =  0,  with  =  Sgnd2,  ^1+  =  — Sgnd2,  and  62  =  — Sgn  {aid2). 
These  hand/eye  configurations  are  defined  as  follows: 

A  dual  solution  (77^-  and  ^1+): 


Xi-  =  TT 


Aj-  =  -Sgn  (^2)  •  tt/2  Zc^_  =  0  i?cj_  = 


Xj+  =  0  Ai+  = -Sgn  (d2)  •  7r/2  =  0  Rc^+  = 

An  isolated  solution  (772): 


do  -f  (oj  —  a2Y 
(^2  T  (®i  +  ^2)“ 

1^2  I 


COSX2  =  —02/01  sinxo  =  — 


\/ai  -  02 
l«ll  ’ 


Zco  — 


2  j  (2  2  \d‘2  Cl 2  G9 
2o?  —  Oo 


Kl  =  ^2  -f  Rc2  sin  A2  = 


/  ■>  9x9 

(Oj  -  02)“ 


Ko  =  Rrn  cos  A9  = 


d2(2aj  —  09) 

3oi(of  -  aj) 

2af  —  a2 


(16) 

(17) 

(18) 
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Proposition  2: 

For  any  2-dof  manipulator  such  that  its  Denavit-Hartenberg  parameters  satisfy 
d2  ^  0  and  |ai|  >  02,  then  for  the  same  values  of  the  second  joint  angle  and 
poses  of  the  camera  that  give  the  dual  quartic  fold  bifurcations,  (xi-,Zc^_ ,  Rc^_) 
and  {xi+,  Zc^^,Rc^^),  there  exists  a  unique  pair  of  values  of  the  first  joint  an¬ 
gle,  (Aj,-,  Aj,+  ),  to  which  corresponds  a  unique  pair  of  hand/eye  configurations, 
hiy-  —  (3^1- )  Aj^/- ,  Zc^_ ,  Rcy- )  and  T~iy+  =  Aj,+ ,  Zc^^ ,  Rc^^  )■>  such  that 

H{x,  A;  Zc^_ ,  Rc^_  ),  in  a  neighborhood  of  (xj- ,  A^,-),  and 
H{x,X]Zc^+  ,-Rcj+)j  in  a  neighborhood  of  (xi+,Aj,+  ), 

are  equivalent  to  the  type  0  bifurcation: 


X-  -H  (5'A  =  0  with  =  -Sgnd^  and  -  Sgnd2- 


The  values  of  the  first  joint  angle  corresponding  to  these  bifurcations  are  defined 
as  follows; 


cos  A^,- 


21^2!  •  (ui  -  02) 

(ay—  02)^  -f  <^2 


,  2|d2l  •  (ai  +  02) 

-  (a,  +  02)2  d2 


Sgnd2  •  ((ui  -  02)^  - 
and  smAj,-  =  _  ^2)2  +  ^ 

Sgn  d2  •  ((ai  +  02)^  -  dfj 
and  sinAi,+  =  (aj  +  02)2  + 


(19) 

(20) 


Proposition  3: 

For  any  2-dof  manipulator  such  that  its  Denavit-Hartenberg  parameters  sat¬ 
isfy  d2^0  and  \ai\  >  02,  then  there  exists  a  unique  hand/eye  configuration 
no=  (a:o,  Ao;  ^cq,  Rcq)  such  that  H{x,  A;  Zco,Rco)  is  equivalent  in  a  neighborhood 
of  (xo,  Ao)  to  the  pitchfork  bifurcation  (type  6): 


x^  +  SXx  =  0,  with  6  =  Sgn  (01^2) 


The  hand  eye  configuration  corresponding  to  this  organizing  center  is  defined 
as  follows; 


(21) 

(22) 
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Proposition  4: 

For  any  2-dof  manipulator  such  that  its  Denavit-Hartenberg  parameters  satisfy 
d2  ^  0  and  |ai|  >  02,  then  for  the  same  pose  of  the  camera,  {Zcq,Rcq),  and 
value  of  the  second  joint  angle,  q2  =  xq,  that  give  the  pitchfork  bifurcation,  there 
exists  a  unique  value  of  the  first  joint  angle,  Aq',  defining  a  unique  hand/eye 
configuration  Hqi  =  (a;o,  Xqi,Zcq,  Rcq),  such  that  H{x,  A;  Zcq,Rcq)  is  equivalent  in 
a  neighborhood  of  (sqjAq')  to  the  simple  bifurcation  (type  2): 

=  0. 


The  value  of  the  first  joint  angle  corresponding  to  this  organizing  center  is  defined 
as  follows: 


cos  Aq/ 


ai 

2Rcq 


and 


sin  Aq/ 


CIj  +  2^2 

2d2Rco 


(23) 


5.2.2  Proof  of  these  propositions 

All  possible  organizing  centers  for  this  geometry  of  manipulator  are  covered  by  three 
cases  studied  in  Appendix  B:  Cases  3.2.2  (configurations  Hi-,  Hi+,  Hy-,  and  4.2 

(configuration  H2),  and  2.2  (configurations  Hq  and  Hqi). 


Proof  of  Proposition  1: 

The  quartic  fold  bifurcation  (x^  +  ^A  =  0  is  observed  when  the  following  three  conditions 
are  satisfied: 

One  defining  condition: 

h  —  hx  —  hxx  ~  hxxx  ~  0- 
Two  nondegeneracy  conditions: 

2.  C  ~  Sgn  hxxxx  ^  0 

3.  ^  =  Sgn  hx  0. 


We  deal  separately  with  the  case  of  the  “isolated”  bifurcation  and  of  the  “dual”  bifurca¬ 
tion,  which  we  treat  here  first. 


From  Appendix  B,  Case  3.2.2,  we  know  that  if  Zc  =  0  and  =  (1  —  £)7r/2,  with  e  =  ±1, 
then  all  odd-order  partial  derivatives  of  h  with  respect  to  92  are  null.  The  expressions  for 
the  first  even-order  derivatives  are 


=  £  ((oi  +  +  ^2  •  K\  -  (gi  -f-  £02)  •  K'^ 


d-h 

dql 


(921  91)  =  {{ai  +  ea2)~  -b  d2  ■  Ki  -  {ai  +  2ea2)  ■  K2') 


=  -2^92,91)  +  f -^'2. 
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One  has  to  choose  K2  =  0  in  order  for  the  second  derivative  to  be  zero,  and  this  in 
turn  implies  that  K\  =  -(ai  +  £a2)^/<^2  if  we  want  =  0  as  well.  From  these  values  of 
Ki  and  71^2  >  we  get  equations  for  72*  and  A  = 


i2*cos9i*  =  =  0 

72*  sin  ql  =  —  d2  = 


+  (fli  +  £02)^ 

d2 


It  is  then  easy  enough  to  verify  that  the  values  of  72^  and  A  =  5*  are  indeed  the  ones 
given  by  (16)  and  (17).  On  the  other  hand, 


dH 

dqj 


(qhqi)  =  0, 


so  that  for  both  configurations  Tii-  and  771+,  C  =  Sgnai.  It  just  remains  to  verify  that 
hx  7^  0,  which  is  easy  enough,  as 


hx  =  - 


e{ai  4-  £02)  •  [dj  +  (cti  +  £02)^) 
d2 


^  0. 


Finally,  Sgn  (oi  +  £02)  =  Sgn  ai,  so  that  ^  =  Sgn  hx  =  —e  •  Sgn  (cid2). 

In  conclusion: 

*  If  £  =  —1  (configuration  72i-),  then  (  =  Sgnai  and  ^ 
bifurcation  observed  is  equivalent  to  a:'*  +  Sgn  (^2)  •  A  =  0 

*  If  £  =  +1  (configuration  77i+),  then  C  =  Sgnai  and  ^  ■■ 
bifurcation  observed  is  equivalent  to  —  Sgn  (^2)  •  A  =  0 

From  Appendix  B,  Case  4.2,  we  know  that,  if  Zc  =  2  |ai|a2  Q2/(^®l  ~  *^2)  (which, 

since  |ai  |  >  a2  always  lies  between  0  and  a2),  there  exists  a  unique  joint  angle  92  ^  [0;  27r[ 
such  that  cos^l  =  -a2/ai  and  sin^^  =  -y^af  -  a^/lai|.  Then,  there  exists  a  unique  pair 
(72c*,  ?i)  €  [0,27r[xR,  such  that 


=  Sgn(aid2)5  so  that  the 
:  — Sgn(ald2)^  so  that  the 


(24) 

(25) 


In  this  case,  h  and  its  first  three  partial  derivatives  with  respect  to  92  are  zero,  but  the 
fourth  order  derivative  is  h^^xx  =  6a^a2/(2af  -a^),  which  cannot  be  equal  to  zero.  Then, 
=  Sgn  hxxxx  ~  Sgn  ai  ^  0.  * 
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Next,  we  prove  that  condition  3  applies 

hx  =  d2K2C2  -  {do  -  Kx)C2  ■  (ai  +  G2C2). 

Replacing  K\  and  K2  by  the  expressions  given  in  (24)  and  (25),  we  get: 

_  -3a2d2(af  -g|)  _  a2{a\  -  aj)  ((«!  "  4)^  +  ^2(^2  "  ^af)) 

2g2  —  G2  a^d2{2a^  —  a^) 

a2(aj  -  aj)  ((af  -  +  d|(Gf  +  a,)) 

ald2{2a^  —  02)  ’ 

so  that  we  get  ^  =  Sgn  hx  =  — Sgn  ^2  and  therefore  62  =  C  '  ^  =  ~Sgn  (Gid2),  which  con¬ 
cludes  our  proof.  □ 

Proof  of  Proposition  2: 

The  type  0  bifurcation  (  =  0  is  observed  when  the  following  three  conditions 

are  satisfied: 

One  defining  condition: 

1.  h  =  hx  ==  0 

Two  nondegeneracy  conditions: 

2.  (  =  Sgn  hxx  ^  0 

3.  e  =  Sgn(/i,)#0. 

The  codimension  of  this  bifurcation  is  zero,  which  means  that  it  is  always  present,  what¬ 
ever  the  pose  of  the  camera  may  be.  Its  shape  is  that  of  a  horizontal  hyperbola  and  its 
“role,”  in  the  complete  bifurcation  diagram,  is  to  connect  branches  that  are  produced  by 
other,  more  singular  bifurcations. 

We  show  in  Appendix  B,  Case  3.2.2  that,  for  e  =  —1  and  for  e  =  -fl,  the  equation  h  —  0, 

(gi  -f  £G2)“  -I-  d2  ■  Ki  -  (ai  +  £G2)  •  K2  =0, 

admits  two  solutions  sharing  the  same  value  for  Rq.  The  first  solution  gives  rise  to  one  of 
the  dual  quartic  fold  bifurcations,  which  we  just  studied.  The  second  solution  corresponds 
to 

Kl*  =  and  K;*  =  2(gi  -f  eao),  (26) 

02 

and  it  is  easy  to  verify  that  this  solution  is  obtained  for  the  values  of  Rc  and  A  given 
in  (16)  and  (20),  and  in  (17)  and  (20). 

Since  the  hand/eye  configurations  for  this  bifurcation  only  differ  from  the  one  that 
gives  rise  to  the  quartic  folds  in  the  values  of  the  first  joint  angle,  \  =  q\,  most  of  the  last 
proof  corresponding  to  these  solutions  applies  here  as  well.  In  particular,  we  have  already 
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established  that  h  =  0,  =  0  and  hxx  +  0,  although  we  have  yet  to  check  its  sign.  We 

must  also  verify  the  sign  of  h\\ 

hxx  ~  3cii02 

h\  =  d2K2C2  —  (<^2  “  K\)C2  •  (oi  +  02C'2), 

so  that,  if  we  replace  Ki  and  1^2  by  the  values  given  in  (26),  we  get 

hxx  =  2a2{ai  +  £02)  ^  0 

e  •  (ui  +  £^2)  •  ((«!  +  £02)^  +  ^2) 

h,  =  - ^  0. 

Therefore,  (  =  Sgnhxx  =  Sgnai  and,  since  jail  >  02  ^  =  Sgn hx  =  £  Sgn(aid2),  so  that 
6  =  C  ■  (  =  s  ■Sgnd2.  In  conclusion,  6^-  =  -Sgnd2  and  6^,+  =  Sgnd2,  which  concludes 
our  proof. 

Proof  of  Proposition  3: 

The  pitchfork  bifurcation  =  0  is  observed  when  the  following  three  conditions 

are  satisfied: 

Two  defining  conditions: 

1.  h  —  hx  “  hxx  “  ^ 

2.  ^A  =  0 

Two  nondegeneracy  conditions: 

3.  ^  Sgn  hxxx  ^  0 

4.  ^  =  SgnhxX  0. 

Points  1  and  3  were  essentially  covered  in  Appendix  B,  Case  2.2.  There,  we  saw  that, 
for  Zc  =  02  and  ^2  =  -7r/2,  =  0  for  all  values  of  51,  and  that  the  condition  hx  =  0 

simplifies  to 

d2-Ki-ai-K2  =  -al  (27) 

Since  the  second  order  derivative  of  h  with  respect  to  92  is  also  a  linear  function  of  Ki 
and  K2-,  hxx  =  3aia2  —  2027^2,  we  can  calculate  K\  and  K2  such  that  h  =  hx  =  hxx  =  0: 

K:  =  d2  +  R*c  sin  ql  =  -^  and  =  K  cos  ql  =  3ai/2  (28) 

202 

It  is  then  easy  to  verify  that  the  values  of  X  =  ql  and  corresponding  to  (28)  are  the 
ones  given  in  (21)  and  (22).  In  this  case,  hxxx  —  3o2  >  0,  so  (^  =  1.  ■ 

The  proof  of  point  2  is  straightforward,  since  C2  is  a  factor  of  hx: 

hx  =  — (oi  +  02C2)  ■  C2  ■  {d2  —  Ki)  +  d2K2C2- 

For  92  =  Ao  =  — w/2,  we  therefore  get  hx  =  0-  " 
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Finally,  we  prove  that  point  4  applies  as  well: 

hx\  =  —d2K2S2  +  a2(c?2  —  Ki)C2S2  +  (c?2  —  K\)  •  {ai  +  a2C2)S2, 
so  that,  if  we  replace  Ki  and  K2  by  the  values  given  in  (28), 


^xX  — 

Therefore,  ^  =  Sgn  h^x 
proof. 


301^2  /  Uj  \ 

=  Sgn(Gic?2)  and  S  = 


ai  ■ 


{ai  + 

~^2 


^  0. 


C  ■  (  —  Sgn  (01^2),  which  concludes  our 

□ 


Proof  of  Proposition  4: 

The  simple  bifurcation  or  the  isola  (  {x^  +  =  0  are  observed  when  the  following 

three  conditions  are  satisfied: 

Two  defining  conditions: 

1.  h  =  hx  =  ^ 

2.  /lA  =  0 

Two  nondegeneracy  conditions: 

3.  C  =  Sgn  hxx  #  0 

4.  ^  =  Sgn  (det  d-h)  ^  0. 

If  ^  =  +1,  the  bifurcation  is  an  isola;  if  ^  =  —1,  it  is  a  simple  bifurcation. 

We  show  in  Appendix  B,  Case  2.2  that  (27)  admits  two  solutions  sharing  the  same  value 
for  Re-  The  first  solution  gives  rise  to  the  pitchfork  bifurcation,  which  we  just  studied. 
The  second  solution  corresponds  to 

Kl  =  —a\l2d2  and  K2  =  oi/2,  (29) 

and  it  is  easy  to  verify  that  this  solution  is  obtained  for  the  values  of  and  A  given 
in  (21)  and  (23). 

Since  the  hand/eye  configuration  for  this  bifurcation  only  differs  from  the  one  that 
gives  rise  to  the  pitchfork  in  the  value  of  the  first  joint  angle,  A  =  52,  most  of  the  last 
proof  applies  here  as  well.  In  particular,  we  have  already  established  that  /i  =  0,  =  0, 

hx  =  0.  We  also  know  that  hxx  ^  0,  although  we  have  yet  to  check  its  sign.  Finally,  we 
must  verify  that  det{d'^h)  7^  0  and  check  its  sign. 

hxx  —  2(l\Cl2  ^2^2  —  ®2^2  —  ^0.\Q2Co  —  C2d2R\  —  202-^2  T 

G1C2/F2  +  4g2C'|/\2  —  GiQ2>5'2  —  4g2C2S’2, 


SO  that,  if  we  set  qo  —  — 7r/2  and  replace  K\  and  K2  by  the  values  given  in  (29),  we  get 

hxx  —  2a2G2  7^  0. 
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Replacing  in  the  expression  of  the  Hessian  matrix,  det{(Ph),  we  get 

— ai(ai  +  d^] 


det{d^h)  = 


2aia2 

-ai(af  +  dl) 
2c?2 


2d2 

0 


^l{al  + 


<  0. 


Therefore,  C  =  Sgnh^j;  =  Sgnai  and  ^  =  Sgn  (det(d2/i))  =  -1,  so  that  the  bifurcation 
observed  will  always  be  a  simple  bifurcation.  D 

5.3  Manipulator  Geometry  Type  A.3:  d2^0  and  0<  laj  <^2 

In  this  case, the  behavior  of  function  h  is  rather  similar  to  that  encountered  with  Type  A.l 
geometries.  We  encounter  again  the  “dual”  quartic  fold  bifurcations  for  hand/eye  coordi¬ 
nations  Hi-  and  Hi+,  as  well  as  the  pitchfork  bifurcation  at  Hq.  The  orientation  of  the 
bifurcation  diagrams  about  these  organizing  centers,  however,  may  be  different,  since  now 
Sgn(ai  -f  02^2)  =  Sgn  (72,  and  not  Sgnai,  as  before.  There  is  nevertheless  an  important 
difference  between  the  topologies  associated  with  type  A.l  and  type  A.3  manipulators 
since  one  of  the  quartic  folds  encountered  in  Proposition  1  is  being  here  “replaced”  by 
two  pitchfork  bifurcations  (Case  4.3). 

5.3.1  Identification  of  the  bifurcations 

Proposition  5: 

For  any  2-dof  manipulator  such  that  its  Denavit-Hartenberg  parameters  satisfy 
d2  ^0  and  0  <  |ai|  <  02,  there  exist  two  configurations  of  the  hand/eye  system. 

Hi-  =  {xi-,\i-]Zc^_,Rc^_)  and  Hi+  =  {xi+,Xi+;  Zc^^,Rc^+)  such  that 

H{x,  A;  Zc^_ ,  Rc^_ ),  in  a  neighborhood  of  (xj- ,  Aj- ),  and 
H{x,X-,Zc^^  ,  ),  in  a  neighborhood  of  (xi+,  Ai+ ), 

are  equivalent  to  the  quartic  fold  bifurcation  (type  7): 

x^  -f  6A  =  0,  with  dj-  =  di+  =  —Sgn  (01^2)- 


These  dual  hand/eye  configurations  are  defined  as  follows; 


X 


^  do  +  (ai  —  02)^ 

^_  =  X  Ai-  =  -Sgn  (d2)  •  7r/2  =  0  Rc^_  = 


^  do  +  (ai  +  02)^ 

xi+  =  0  Ai+  =  -Sgn  (d2)  •  7r/2  =  0  Rc^+  = - 
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For  any  2-dof  manipulator  such  that  its  Denavit-Hartenberg  parameters  sat¬ 
isfy  £^2  ^  0  and  0  <  |ai|  <  G2,  then  for  the  same  values  of  the  second  joint 
angle  and  poses  of  the  camera  that  give  the  “dual”  quartic  fold  bifurcations, 
(xi-,Zc^_,Rcj^_)  and  {xi+ ,  Zc^^,  there  exists  a  unique  pair  of  values  of 

the  first  joint  angle,  which  defines  a  pair  of  corresponding  hand/eye 

configurations,  =  {x^- ,  A^,- ,  ,  Rc^_ )  and  H^,+  =  {xi+ ,  Aj,+ ,  ,  Rc^_^_), 

such  that 

H{x,X-,Zc^_,Rc^_),  in  a  neighborhood  of  (x^-jA^,-),  and 
H{x,\-,Zc^^,Rc^+),  in  a  neighborhood  of  (2:i+,Aj,+  ), 
are  equivalent  to  the  type  0  bifurcation: 

2  ^ 

X  -(-  (5A  =  0  with  =  — Sgnd2  and  fj,+  ==  Sgnd2. 

The  values  of  the  first  joint  angle  corresponding  to  these  bifurcations  are  defined 
as  follows: 


cosAj,-  = 


cos  A-1/*^  “ 


21^2!  •  (gi  —  G2) 
(gi  —  G2)^  + 

21^2!  •  (gi  -h  G2) 
(gi  +  02)“  +  <^2 


and  sinAj,-  = 


Sgnd2  •  ((gi  —  02)^  —  ^2) 


(gi  —  G2)^  +  dl 


and  sinAj,+  = 


Sgnd2  •  ((gi  +  02)^  + 


(gi  +  G2)^  +  dl 


Proposition  7: 


For  any  2-dof  manipulator  such  that  its  Denavit-Hartenberg  parameters  sat¬ 
isfy  ^2  ^  0  and  0  <  |gi|  <  G2,  then  there  exists  a  unique  triple  of  configura¬ 
tions  of  the  hand/eye  system,  'Ho  =  (xq,  Aq;  Zcq.Rco),  ^8  =  (a^s,  Ag;  Zcg,  Rc^),  and 
Ho  =  (xg,  Ag;  Zcg,  f^cg),  such  that 

H{x,  X]  Zcq.Rcq),  in  a  neighborhood  of  (xo,Ao), 

H{x,  A;  Zcg.Rcs)')  in  a  neighborhood  of  (xs,  Ag),  and 
H{x,  A;  Zcs,Rcq),  in  a  neighborhood  of  (xg,  Ag), 

are  all  equivalent  to  the  pitchfork  bifurcation  (type  6): 

x^  -f  6Xx  =  0,  with  ^0  =  ^8  =  ^9  =  Sgn  (gic?2)- 
Hand  eye  configuration  Ho  is  defined  as  follows: 
xo  =  q*2  = 


sin  Aq  = 


a\  -  2dl 
2d2Rco 


cos  Aq  = 


Z(^Q  —  ^2,  and  Rcq  — 


^Gj  —  2^2)  -f  902^2 

2ld7j 
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Hand/eye  configuration  Hs  is  defined  in  terms  of  the  unique  real  solution  Cf  of 
the  following  cubic  equation: 


(ai  +  02  ■  (®1  ®2  ■  X^)- 


cosxs  =  C2  and  sinarg  =  82=  — 

„ _ -2aia2.S'2^ 

~  2ai  -3aiC'|2-02Q^’ 

(a\  +  02  •  ^*9)^  , 

Kl  =  d2  +  J?c8sinA8  =  — 7 — and 
^  "  d2  (2oi  -  SoiQ^  -  02(71®) 

V*  —  n  \  —  3ai(oi  +  02  •  <7|)6'2^ 

K2  -  i?c8  cos  As  -  2ai-ZaiCf-a2Cf 

Finally,  hand/eye  configuration  Tig  is  defined  as  follows: 


cosxg  =  — 01/02,  sma;g  =  - , 

0.2 

Ag  =  -Sgnd2  •7r/2,  Zc^  =  y^o^  -  of,  and  Rc^  =  \d2\. 


(30) 


(31) 


Proposition  8: 

For  any  2-dof  manipulator  such  that  its  Denavit-Hartenberg  parameters  satisfy 
d2  ^  0  and  |ai|  >  02,  then  for  the  same  pose  of  the  camera,  (ZcojRco); 
value  of  the  second  joint  angle,  q2  =  xq,  that  give  the  pitchfork  bifurcation,  there 
exists  a  unique  value  of  the  first  joint  angle,  Ag/,  defining  a  unique  hand/eye 
configuration  Tig'  =  (2:0,  Ag/,  Zcq,Rcq)-,  such  that  H{x,  A;  Zcq,  Rcq)  is  equivalent  in 
a  neighborhood  of  (a:g,  Ag/)  to  the  simple  bifurcation  (type  2): 

-  A^  =  0. 


The  value  of  the  first  joint  angle  corresponding  to  this  organizing  center  is  defined 


as  follows: 


cos  Ag/ 


ai 

2Rco 


and 


sin  Ag/ 


Oj  +  2(^2 

2d2Rco 


5.3.2  Proof  of  these  propositions 

All  possible  organizing  centers  for  this  geometry  of  manipulator  are  covered  by  three 
cases  studied  in  Appendix  B:  Cases  3.2  (configurations  Hi-  and  Hi+),  Case  2.2,  which 
corresponds  to  the  pitchfork  bifurcation  observed  at  configuration  T^g,  and  Case  4.3,  which 
corresponds  to  the  pitchfork  bifurcations  observed  at  configurations  Hs  and  Tfg. 
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Proof  of  Proposition  5: 

The  proof  of  this  proposition  is  almost  identical  to  that  of  Proposition  1,  regarding  dual 
hand/eye  configurations  and  '7^2+ •  The  only  differences  involve  the  signs  of  non-zero 
derivatives: 

hxxxx  ~  6oi0t2  ^  0 


—e  (gi  -f  ea2)  ■  {{a\  -f  £02)^  +  do) 

hx  =  - ^ ^  +  0. 

Therefore,  C  =  Sgnhxxxx  =  Sgnui,  as  with  manipulator  type  A.l.  On  the  other 
hand,  since  |ai|  <  02,  Sgn  (ui  -{■  ea2)  =  £,  so  that  =  Sgn  7;^  =  — Sgnd2.  Finally,  we 
get  ^  =  C  •  ^  = -Sgn  (01^2).  □ 

Proof  of  Proposition  6: 

The  proof  for  the  type  0  bifurcations  observed  for  configurations  Hy-  and  'Hy+  is  identical 
to  the  one  given  for  manipulator  geometry  type  A.l. 

Proof  of  Proposition  7: 

The  proof  for  the  pitchfork  observed  for  configuration  Tfo  is  identical  to  the  one  given  for 
manipulator  configuration  type  A.l. 

Hand/eye  configurations  Tfg  and  Tfg  both  correspond  to  Case  4.3  of  Appendix  B,  that  is, 
for  values  of  the  second  joint  angle,  92,  such  that  C2  #  0,  52  7^  0,  and 
2ai  —  SuiCl  —  a2C2  ^  0.  Then,  if  Zc.,  Rc-  and  Ai  can  be  expressed  as  functions  of 
q2  as  shown  in  (B.16)  (of  which  (30)  and  (31)  are  just  particular  instances),  we  get 
h  =  hx  =  hxx  —  0..  Furthermore,  since  0  <  |oi|  <  02,  the  term  02  +  aiC2  cannot  be  null, 
which  implies  that  hxxx  ^  0.  We  have  therefore  already  verified  part  of  the  conditions 
determining  the  type  of  these  organizing  centers. 

The  pitchfork  bifurcation  -|-  if  Ax  =  0  is  observed  when  the  following  four  conditions 

are  satisfied: 

Two  defining  conditions: 

1.  h  =  hx  —  hxx  —  0 

2.  hx  =  0 

Two  nondegeneracy  conditions: 

3.  f  =  Sgn  hxxx  7^  0 

4.  f  =  Sgn  hx\  7^  0. 

As  we  just  mentioned,  point  1  was  verified  for  both  Tig  and  Tig  in  Appendix  B,  Case  4.3, 
and  we  just  have  to  check  the  sign  of  hxxx  in  order  to  complete  the  proof  of  point  3.  We 
will  be  able  do  that  once  we  have  obtained  a  condition  for  52,  by  verifying  that  condition  2 
applies. 

h\  =  d2K2C2  —  (^2  —  K\)C2  •  (gi  +  02^2),  (32) 
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so  that,  if  we  replace  Zc,  and  K2  by  the  values  given  in  (B.16),  we  get 

—^'2(01  +  a2C'2)  •  ((«l  +  0,2^2)^  +  ^2  •  (ai  +  026'!)) 

^  6^2  (2ai  —  SaiC*!  —  02(72) 

Since  here  6^2  ^  0,  /ia  =  0  if  and  only  if  q2  is  a  solution  to  one  of  the  following  equations: 

Gi  +  02(72  =  0  or  (33) 

(gi  +  02(72)^  +  ^2  •  (gi  +  02(71)  =  0,  (34) 


Let  us  first  deal  with  the  case  where  (34)  applies,  which  corresponds  to  hand/eye 
configuration  'hCg  in  this  study.  We  need  to  get  the  solutions  of  (34),  which  means  that 
we  must  study  the  values  taken  by  the  following  function: 

F  :  [-1,1]  — >  R 

Y  (oi  +  Q2^)^ 

^  01  +  02^3  • 

The  first  derivative  of  T'(W)  is 

30102(01 +  a2X)2(l -X^) 

^  -  (a.  +  a2X3)^ 

Therefore,  F'{X)  =  0  if  and  only  if  X  =  ±1  or  X  =  -01/02,  and  F  will  vary  on  [-1, 1] 
as  indicated  in  Table  1,  in  the  case  oi  >  0  (the  table  for  — oi  would  simply  be  built  by 
symmetry  with  respect  to  the  Y  axis).  Figure  18  gives  examples  of  typical  graphs  for 
F{X)  both  when  01  <  0  and  when  oi  >  0. 


Table  1  —  Evolution  table  for  F  on  [—1, 1]  (virhen  oi  >  0) 


-1  (-ai/02)^/^  -ai/a2  1 

F'iX) 

0  +  +00  +0  +  0 

F{X) 

+00  (®1  ~  ^2) 

/ 

(oi  —  02)“  —00 

We  can  see  in  Table  1  that  the  reduction  of  F  to  ](— 01/02)^^^^, -oi/^^2]  bijectively 
maps  that  interval  onto  IR“.  As  a  consequence,  for  any  value  of  ^2,  there  exists  a  unique 
X*  e](_ai/o2)^^^, -ai/02]  such  that  F(X*)  =  -<^2^.  Furthermore,  since  F  admits  no 
extrema  outside  of  [-1, 1]  and  lim  F{X)  =  ^lim  F{X)  =  o^  >  0,  W*  is,  as  we  claimed 

X— *■— 00  A— >•+00 

in  proposition  7,  the  unique  real  solution  of  the  cubic  equation 

(oi  +  a2X)^  +  (^2  (oi  +  a2X^). 
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Figure  18  —  Examples  of  typical  graphs  for  F{X)  when  ci  <  0  and  when  cj  >  0. 

We  choose  Cl  =  cos  xg  —  X*.  The  sign  of  sin  xg  is  determined  by  the  expression  for  Zc 
in  (30):  Sgn  Zc  =  — Sgn  <21  •  Sgn  51  ■  Sgn  (2ai  —  3aiC|'  —  a2C|^).  Since  Zc  >  0,  we  must 
have  Sgn  51  =  —Sgn  a\  ■  Sgn  (2ai  —  3gi Cl"  —  a2C|^).  We  know  from  our  analysis  of  F 
that  C|  lies  between  (—<21/(22)^'^^  and  —a-ilao.  it  is  therefore  easy  to  verify,  by  adding  up 
inequalities,  that  Sgn  (2ai  —  3aiC|^  —  aoC^^)  =  Sgn  gi,  which  imposes  that  Sgn  5|  =  —1. 
We  apply  this  information  to  determine  the  sign  of  hxxx' 


hxTT  - 


—60102  (^2  +  oiC|)  5| 
2ai  -  3oiC|2  -  02C|3  ’ 


(35) 


so  that  (  =  Sgn  hxxx  =  — (Sgnoi)^  •  Sgn  5|  =  +1.  We  have  now  proven  that  conditions  1 
through  3  apply.  ■ 

It  just  remains  to  verify  that  hx\  7^  0  and  check  for  its  sign.  The  general  expression  for 
this  derivative  is 


hxX  =  —d2K2S2  +  02(^2  —  AT)C252  +  {do  —  K-[)  ■  (01  +  02C2)52.  (36) 


First,  we  can  use  the  condition  (oi  +  02  •  C|)^  +  (oi  +  02C|^)  =  0  together  with  (B.16) 
and  (30)  to  get  simpler  expressions  for  Ki  and  for  AT  and  Zc  as  functions  of  Ki: 


Z 


C8 


<^2(01  + 

(oi  +  0.0C2Y  T  301^251^ 

(01  +  02CI)  ■  {do  -  A7) 
do_ 

—  20252  •  (^2  —  A I ) 

Uo 


Substituting  for  K2  and  Zc  in  (36),  we  get 


hx),  =  02C|5|  •  {d2  -  KI). 
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Since  C2S2  ^  0,  h^x  is  null  if  and  only  if  d2  —  =  0. 


d2  -  Kl 


Za\d2Sf 

2ai-Za2Cf  -  a2Cf  ^ 


We  already  know  that 


Sgn  (2ai  -  3a2C'2^  -  a2Cf)  =  Sgnai, 
SgnC*!  =  —Sgnai,  and 
Sgn5|  =  -1, 


so  Sgn  {d2  -  K\)  =  Sgnd2  and  therefore 

i  =  Sgn  Kx  =  Sgn  C2  •  Sgn  SI  ■  Sgn  (^2  -  Ki) 
=  Sgn  (01^2)- 


In  conclusion,  =  C,  '  i  —  Sgn  (01^2).  ■ 

The  proof  for  Tfg  is  fortunately  much  simpler.  We  return  to  (32)  and  get  hx  =  0  hy 
choosing  Cf  =  —01/02-  Substituting  for  C2  in  (B.16),  we  obtain 

Kl  =0,  K2  =  0,  andZc  =  -Sgn^l  •  i/aj  -  of. 


Since  we  have  imposed  here  Zc  ^  0,  we  must  therefore  choose  S2  <  0.  Similarly,  from 
Ki  =  K2  =  0,  it  is  easy  to  deduce  that  Rc  =  1^2 1  and  Ag  =  -Sgnd2  •  7r/2,  which  completes 
our  determination  of  Tig,  as  given  in  (31). 

We  only  have  now  to  determine  the  sign  of  hxxxi  prove  that  hxX  is  not  null,  and  check 
for  its  sign.  The  expression  for  hxxx  is  the  same  as  in  (35)  and,  after  substituting  for  C2, 
simplifies  to  hxxx  =  — So^S'l-  So,  C  =  Sgnhx^x  =  +1-  ■ 

The  expression  for  hxX  is  still  (36).  At  organizing  center  Tig,  this  derivative  is  equal 


to 


hx\  =  -01^252  =  aid2\f^-  a\la2  +  0. 


Therefore,  ^  =  Sgn  hxX  =  Sgn  (01^2)  and  dg  =  C  •  ^  =  Sgn  (01^2). 


Proof  of  Proposition  8: 

The  proof  for  the  simple  bifurcation  or  isola  observed  for  hand/eye  configuration  Tig'  is 
identical  to  the  one  given  for  manipulator  geometry  type  A.l. 

5.4  Manipulator  Geometry  Type  A.2:  ^2^0  l«il=«2 

Since  this  type  of  manipulator  geometry  is  in  fact  a  “boundary”  between  types  A.l 
and  A. 3,  it  should  not  come  as  a  surprise  that  some  of  the  organizing  centers  we  en¬ 
countered  in  the  two  previous  subsections  exist  for  A. 2-type  manipulators  as  well.  On  the 
other  hand,  one  of  the  “dual”  quartic  folds,  either  Tfi-  or  Tfi-h,  and  its  associated  type 
0  bifurcation,  merge  together  to  form  an  organizing  center  of  codimension  greater  than  3 
that  did  not  exist  for  either  type  A.l  or  type  A.3  manipulators. 
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5.4.1  Identification  of  the  bifurcations 

Proposition  9: 

For  any  2-dof  manipulator  such  that  its  Denavit-Hartenberg  parameters  satisfy 
d2  ^  0  and  |gi|  =  02,  then  there  exists  a  unique  configuration  of  the  hand/eye 
system,  Hs  =  (xa,  A3,  Zcg,  i^cs),  with 

X3  =  (1  + Sgn  (ai))  •  x/2  A3  =  -Sgnd2-7r/2 

Zc3  =  0  Rc3  -  M2 1, 

such  that  H{x,  A;  Zc^^Rc^)  is  equivalent,  in  a  neighborhood  of  (3:3,  A3),  to  a  bifur¬ 
cation  of  codimension  >  4. 

Proposition  10: 

For  any  2-dof  manipulator  such  that  its  Denavit-Hartenberg  parameters  sat¬ 
isfy  (^2  ^  0  and  0  <  Mii  <  there  exist  a  unique  hand/eye  configuration, 
H\^  =  (xic,  Alt;  that  H{x,  X:  ,  Rc^.),  in  a  neighborhood  of 

(a^itjAit)  is  equivalent  to  the  quartic  fold  bifurcation  (type  7): 

x'^  -{■  SX  =  0,  with  8  —  — Sgn(aid2). 

This  hand/eye  configuration  is  defined  as  follows: 


£  =  Sgnci, 

xy.  =  (1  —  £)  •  7r/2,  Alt  =  — Sgn  (^2)  •  ;r/2, 

t7  n  .  ..  .in  <^  +  4a| 

^ci€  —  U,  and/icif  —  I 

Proposition  11: 

For  any  2-dof  manipulator  such  that  its  Denavit-Hartenberg  parameters  satisfy 
do  ^  0  and  0  <  Mli  <  <^2?  then  for  the  same  values  of  the  second  joint  angle  and 
pose  of  the  camera  as  in  configuration  Tfy,  (xp,  Zcje,i?cit  )there  exists  a  unique 
value  of  the  first  joint  angle,  (A^/t,  which  defines  a  corresponding  hand/eye  con¬ 
figuration,  —  (xit,  Ai/t,Zcjc,i?cif)5  such  that  H[x,X-,  Zc^.  ^  Rc^t)^  in  a  neigh¬ 
borhood  of  (xit,  Aj/t),  is  equivalent  to  the  type  0  bifurcation: 

x“  dA  =  0,  with  8  =  — Sgn(aid2). 


The  value  of  the  first  joint  angle  corresponding  to  this  bifurcation  is  defined  as 
follows: 


cos  Aj/f 


2M2I  ■  (ni  ■b£G2) 

(gi  -1-  £^2)“  "b  ^9 


and 


sin  Aj/r 


Sgn  do  ■  ((«!  +  £G2)“  —  <^2) 
(qi  -j-  £02)""  T  ^2 
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Proposition  12: 

For  any  2-dof  manipulator  such  that  its  Denavit-Hartenberg  parameters  sat¬ 
isfy  ^2  7^  0  and  |ai|  <  02,  then  there  exists  a  unique  hand/eye  configuration 
Hq  =  (xo,  Ao;  Zcq.Rcq)  such  that  h{x,  A;  Zcq.Rcq)  is  equivalent  in  a  neighborhood 
of  (xo,  Ao)  to  the  pitchfork  bifurcation  (type  6): 

+  SXx  =  0  with  S  =  Sgn  (01^2) 


The  hand  eye  configuration  corresponding  to  this  organizing  center  is  defined  as 
follows: 

XQ  —  ^2  ~ 


ZcQ  —  ^25 


Rcq  — 


(al  —  2^2)  +  9afd2 


sinAo  = 


of  -  2^2 

26.2  Rco 


2\d2\ 


cos  Ao  = 


3ai 


Co 


Proposition  13: 

For  any  2-dof  manipulator  such  that  its  Denavit-Hartenberg  parameters  satisfy 
^2  7^  0  and  |ai|  >  02,  then  for  the  same  pose  of  the  camera,  (Zco,Rco)>  ^^6 
value  of  the  second  joint  angle,  q2  =  xq,  that  give  the  pitchfork  bifurcation,  there 
exists  a  unique  value  of  the  first  joint  angle,  Ao',  defining  a  unique  hand/eye 
configuration  'Ho>  =  (xo,XQi,ZcQ,Rco)i  such  that  H{x,X-,  Zco,Rco)  is  equivalent  in 
a  neighborhood  of  (xo,  Aq/)  to  the  simple  bifurcation  (type  2): 


x^-X^  =  0. 


The  value  of  the  first  joint  angle  corresponding  to  this  organizing  center  is  defined 
as  follows:  „ 

Cl  1  .  ^  +  2(^2 


cos  Aq'  — 


2R 


and  sinAo'  = 


•Co 


262  R, 


•CO 


5.4.2  Proof  of  these  propositions 

All  possible  organizing  centers  for  this  geometry  of  manipulator  are  covered  by  two  cases 
studied  in  Appendix  B:  Cases  3.1  (configuration  Hz),  3.2  (configuration  Hi^),  and  2.2, 
which  corresponds  to  the  pitchfork  bifurcation  (configuration  Hq)  and  its  associated  sim¬ 
ple  bifurcation  or  isola  bifurcation  (configuration  'Hq')- 

Proof  of  Proposition  9: 

Hand/eye  configuration  Hz  in  fact  represents  a  degenerate  form  of  one  of  the  “dual” 
configurations,  Hi-  and  Hi+  giving  rise  to  quartic  fold  bifurcations  for  type  A.l  and 
type  A.3  manipulators.  For  the  type  A.2  manipulators  that  we  are  considering  here, 
ai  =  £02,  with  £  =  Sgnoi,  and  hand/eye  configurations  Hi-t  and  Hi,-c  coincide  (at  Hz), 
thus  giving  rise  to  a  very  singular  bifurcation. 
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We  see  in  Appendix  B,  Case  3.1  that,  if  52  =  (1  +  Sgn  ai)  •  -k Zc  =  0,  and  K\  =  K^—  0, 
then 

h  —  /lx  =  /^zi  ~  hxxx  ~  Oj  but  hxxxx  ~  6ctl(Z2  ^  0- 

There  are  only  two  elementary  bifurcations  of  codimension  <  3  that  satisfy  these  con¬ 
ditions:  the  quartic  fold  (x‘^  -f^A  =  0,  which  we  have  already  seen,  and  the  “type  10” 
bifurcation  -|-  ^Xx  =  0. 

It  is  easy  to  verify  that,  for  the  hand/eye  configuration  we  have  here, 

h-x  =  (oi  +  0.2C2)  •  C2  •  {do  —  Ki)  -f  d2K2C2  =  0, 

since  C2  =  — Sgnoi  and  K2  =  0.  The  bifurcation  observed  here  is  therefore  not  a  quartic 
fold.  Similarly, 


hxX  —  {—0'lS2  —  202^252)  •  {d2  —  Ki)  —  d2K2S2  =  0, 

since  S2  =  0.  The  bifurcation  corresponding  to  this  hand/eye  configuration  is  therefore 
not  “type  10”  either.  Its  codimension  must  then  be  greater  than  3.  □ 

Proof  of  Proposition  10: 

The  proof  of  this  proposition  is  almost  identical  to  the  proof  of  Proposition  1  regarding 
dual  hand/eye  configurations  and  The  only  differences  involve  the  signs  of 

non-zero  derivatives: 

^xxxx  ~  6giC2  ^  0 

d-  £02)  ■  ((<^1  "h  £^2)^  "I" 

'd2 

Therefore,  (  =  Sgn  hxxxx  =  Sgnai,  as  with  Configuration  A.l.  On  the  other  hand, 
since  ai  =  £02,  we  get  Sgn  (gj  -f  £G2)  =  Sgn  (2£G2)  =  £,  so  that  (  =  Sgn  hx  =  —Sgn  d2 
and  therefore  S  =  (  ■  ^  =  —Sgn  (gio?2).  □ 

Proof  of  Proposition  11: 

The  proof  for  the  type  0  bifurcation  observed  for  configuration  is  identical  to  the  one 
given  for  manipulator  geometry  type  .4.1. 

Proof  of  Proposition  12: 

The  proof  for  the  pitchfork  observed  for  configuration  Tio  is  identical  to  the  one  given  for 
manipulator  configuration  types  A.l  and  A. 3. 

Proof  of  Proposition  13: 

The  proof  for  the  simple  bifurcation  or  isola  observed  for  configuration  is  identical  to 
the  one  given  for  manipulator  configuration  types  A.l  and  .4.3. 
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5.5  Manipulator  Geometry  Type  A.4:  d2^0  and  ai=0 

The  most  common  geometry  among  manipulator  arms  unfortunately  also  seems  to  be  the 
least  suitable  for  hand/eye  coordination  purposes. 

Proposition  14: 

For  any  2-dof  manipulator  such  that  its  Denavit-Hartenberg  parameters  satisfy 
^2  7^  0  and  a\  =  0,  then  for 

2  ^2 

A4  =  -Sgn (^2)  •  7!'/2,  ^C4  =  0,  and  Rc^  = 

H{x,X]  Zc^^Rc^)  is  equivalent,  for  any  0:4  €  IR,  in  a  neighborhood  of  (x4,  A4)  to  a 
bifurcation  of  infinite  codimension. 

Proof  of  Proposition  14: 

Setting  ai  =  Z*  =  0  and  i?*  =  +  d2)/d2  in  the  expression  of  h{q2, 9i),  we  obtain 

^(92,91)  =  {al  +  dl)-{\  +  S\)-C2  -  —  -CiCl. 

02 

It  is  then  trivial  to  check  that,  for  A4  =  5*  =  {2k  +  l)7r,  then  • ,  A4,  Z*,  J?*)  is  the  null 
function. 

5.6  Manipulator  Geometry  Type  B.l:  and  laj  >02 

This — admittedly  rather  uncommon — manipulator  geometry  produces  the  only  codimen¬ 
sion  3  bifurcation  that  we  will  encounter  during  this  study. 

Proposition  15: 

For  any  2-dof  manipulator  such  that  its  Denavit-Hartenberg  parameters  satisfy 

^2  =  0  and  |ai  |  >  02,  there  exists  a  unique  hand/eye  configuration  Hh  =  (xs,  X^^Zc^^Rc^)^ 

with 

xz  =  -7r/2,  As  =  (1  -  Sgnoi)  •  7r/2,  Zc^  =  «2  Rc^  =  \ai\,  (37) 

such  that  H{x,X]  Zc^,Rc^)  is  equivalent,  in  a  neighborhood  of  (2:5,  A5),  to  the 
following  elementary  bifurcation  (type  8”  or  type  S"'"): 

-f-  ^5  •  A^  =  0,  with  65  =  -Sgnoi. 


Proof  of  Proposition  15: 

The  elementary  bifurcation  -h  ^A^  =  0  is  observed  when  the  following  four  conditions 
are  satisfied: 

Two  defining  conditions: 

1.  h  =  hx  =  0 

2.  hx  =  det{(Ph)  =  h^v  =  0,  where  v  is  any  vector  such  that  hw  ^  0. 
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Two  nondegeneracy  conditions: 

3.  C  =  Sgn/ixi  7^  0 

4.  ^  =  Sgn  9  7^  0,  where  q  =  h^w  ■  hxx  - 
First,  we  prove  that  condition  1  applies. 

For  all  Zc  such  that  Zc  <02,  there  exists  a  unique  pair  of  numbers  (92, 92*)  ^  [0,  tt]^  such 
that 

sin  92  =  sin  92*  =  —Zcja^ 

cos  92  =  —  cos  92*  =  -^02  —  Zc^/a2- 

Obviously,  92*  =  tt  —  92-  Then,  from  Appendix  B,  Case  1.2,  we  have  the  following: 

•  For  all  i?c  ^  01  +  («2  ■“  ■^c)  5  there  exists  a  unique  9^  G  [0,7r]  such  that 

/\2  =  Rc  •  cos  =  ai  +  —  ai  +  —  Z^'j  ^  . 

Then,  at  (91,92)  and  (—91,92),  h  —  hx  =  0,  but  hxx  =  02(01  +  026*2)  7^  0.  In  this 
case,  (  —  Sgn  hxx  =  Sgnoi. 

1  1 

•  For  all  Rc>  oi  —  ^02  —  Z^'j  ,  there  exists  a  unique  91*  G  [0,  tt]  such  that 

Ko  —  Rc  •  cos  92*  =  Cl  +  026*2*  =  oi  —  ^02  —  Zl'^  ^  . 

Then,  at  (9**1 9D  ^'^d  (—9**, 92*),  h  =  hx  =  0,  but  hxx  =  02(01  +  026*2*)  ^ 
this  case,  (  =  Sgn  hxx  =  Sgn  ai. 

The  value  of  Rc  will  be  determined  next,  but  V  Rc,  (  =  Sgn  oi.  ■ 

Next,  we  prove  that  conditions  2  and  3  apply. 

In  its  expanded  form,  h{q2,q\)  —  (oi  +  026*2)  •  (02  +  01C2  —  RcC\C2  +  ZcS2),  so  that 
its  partial  derivative  with  respect  to  A,  hx  =  RcS\C2  ■  (oi  +  026*2)  is  null  if  and  only  if 
i?c  =  0,  5i  =  0  or  C2  =  0. 

The  determinant  of  the  Hessian  matrix  of  h{x,\)  is 

det{dH)=  J""  =  hxx-hxx-hlx,  (38) 

dxX  nxx 

with 

hxx  =  i?c6'i 6*2  •  (oi  +  026*2)  and 
hxX  —  —.Rc‘S'iC2  •  (oi  +  026*2). 

We  now  study  separately  the  three  cases  that  give  hx  =  0  and  study  them  in  terms  of 
the  results  gathered  in  proving  conditions  1  and  3  and  then  in  terms  of  the  condition 
det{d^h)  =  0. 
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•  J?c  =  0  is  impossible  since  we  just  saw  that  in  order  to  get  h  =  hx  =  0,  we  must  have 
K2  =  RcCi  =  ai  +  02^*2  7^  0 

•  5i  =  0  hxx  =  02  •  (oi  +  a2C'2)5  hxx  =  izRcC2  ■  (ai  +  a2C'2),  and  h^x  =  0.  Then, 
from  (38),  we  see  that  det(d^^)  =  ±i2c<*2C'2  •  (ni  +  a2C'2)^  is  null  if  and  only  if  =  0 
or  C2  =  0.  We  already  know  that  the  former  is  not  possible  and,  since  the  latter 
happens  to  be  the  third  and  final  case  of  our  initial  condition,  we  will  now  study  it 
regardless  of  the  value  of  51. 

•  (^2  =  0  and  Zc  =  —0282  =  02  implies  that  =  — 7r/2.  Then  hxx  =  aia2, 

hxx  =  0,  hxX  =  -Rc^iSi,  and  det(d^h)  =:  -h].x  =  which,  since  Rc  ^  0  and 

ai  0,  can  be  null  only  if  Si  =  0.  Returning  to  the  value  that  we  found  earlier  for  K2, 
we  see  that  K2  =  RcQ  =  ai  implies  that  =  Sgn  ci,  that  is,  ql  =  {1-  Sgn  ai)  •  7r/2. 

In  conclusion,  the  only  hand/eye  configuration  that  gives  us  hx  =  det((Ph)  =  0  (in 
addition  to  the  conditions  for  the  existence  of  a  bifurcation,  h  =  hx  =  0)  is 

Z*  =  0(2,  R*  =  i«l|,  ?2  =  and  9^  =  (1  -  Sgnci)  •  7r/2, 

which  means  that  the  nondegeneracy  term  in  condition  3  is  (  =  Sgnci.  ■ 

Finally,  we  take  care  of  nondegeneracy  condition  4. 

Replacing  in  the  expression  of  the  Hessian  matrix,  det(d^h),  for  all  the  variables  and 
parameters  that  we  have  determined,  we  get 


det(d^h)  = 


0102 

0 


0 

0 


We  can  select  v  =  (0, 1)'  as  a  non-zero  vector  of  Kerd^h  and  we  can  trivially  verify  that 
hy^yx  =  hxxxx  =  -RcC\C2  ■  (ai  +  a2C'2)  =  0.  The  expression  for  the  differential  form  q  is 
therefore 


9 


—  h'j 


•  hx 


-3h 


2 

vvx 


0-3h 


2 

vvx 


=  -3(RcCjS2aif  =  -3a^R^  <  0, 


and  therefore  ^  =  -1,  so  that  S5  =  (  •  ^  =  -Sgnoi,  which  concludes  our  proof. 


5.7  Manipulator  Geometry  Type  B.3:  d2  =  0  and  0<  laj  <02 

We  encounter  the  same  organizing  center  as  with  configurations  type  B.l,  plus  another 
particularly  degenerate — one  that  is  made  possible  since  oi  -f  a2C2  can  now  be  null.  In 
fact,  the  true  organizing  center  for  this  manipulator  geometry  would  be  observed  for 
=  0.  We  have  decided  to  avoid  studying  this  case,  but  it  shows  up  here  uninvited. 
What  this  means  is  that  the  neighborhood  of  Rc  =  0  should  be  avoided  for  the  observer, 
but  that  the  influence  of  this  organizing  center  will  be  felt  even  far  away  from  it.  This 
topic  will  be  addressed  in  more  detail  in  Part  II. 
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5.7.1  Identification  of  the  bifurcations 

Proposition  16: 

For  any  2-dof  manipulator  such  that  its  Denavit-Hartenberg  parameters  satisfy 
(^2  =  0  and  |gi|  >  02,  there  exists  a  unique  configuration  of  the  hand/eye  system, 
?^5  =  (xs,  A5,Zc5,i?c5),  with 

0:5  =  -7r/2,  As  =  (1  -  Sgnai)  •  7r/2,  Zc^  =  02,  i?c5  =  |ai|, 

such  that  H{x,  X]  Zc^,  Rc^)  is  equivalent,  in  a  neighborhood  of  (a;5,A5),  to  the 
following  elementary  bifurcation  (type  8“  or  type  S'*'): 

—  S  ■  X"^  =  0,  where  6  =  Sgn ai. 


Proposition  17: 

For  any  2-dof  manipulator  such  that  its  Denavit-Hartenberg  parameters  satisfy 
d2  —  ^  and  |ai|  >  02,  there  exists  a  unique  3-tuple  {x%,X(,\ Zcq)  such  that,  for 
all  values  of  i?c6?  H{x,  X-,  Zc^,  Rcq)  is  equivalent,  in  a  neighborhood  of  (a;6,A6), 
and  (x6,  —As),  to  the  pitchfork  bifurcation  (type  6): 

x^  —  SXx  =  0,  where  S  =  Sgn  ci. 

The  values  of  X6,A6  and  Zcq  are  defined  as  follows: 


cosxfi  = - ,  smare 

02 

Ae  =  7r/2 
^C6  =  y/aj-  «i- 


G2 


5.7.2  Proof  of  these  propositions 

Proof  of  Proposition  16: 

The  proof  for  the  type  8  bifurcation  observed  for  configuration  Tfs  is  identical  to  the  one 
given  for  manipulator  configuration  type  B.l. 

Proof  of  Proposition  17: 

The  pitchfork  bifurcation  -f  if  Ax  =  0  is  observed  when  the  following  three  conditions 
are  satisfied: 


Two  defining  conditions: 

1.  h  =  hx  —  hxx  =  0 

2.  hx  =  0 
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Two  nondegeneracy  conditions: 

3.  ^  =  Sgn  hxxx  ^  0 

4.  ^  =  Sgn  hxx  7^  0. 

1  and  3  directly  follow  from  the  results  of  Appendix  B,  Case  1.1.3,  where  we  showed  that, 
if  q2  =  X6,  Zc  =  yal  -  of,  and  K2  =  0,  then 

Jl  =  fl^  =  hxx  ~  ^ 
hxxx  =  302  y/al  -  7^  0- 

The  condition  K2  =  0  implies  that  A  =  =  ±7r/2  since,  as  we  explained  earlier,  we  must 

exclude  the  case  Rc  =  0.  In  any  case,  (  =  Sgn  hxxx  =  1- 
Proving  that  2  and  4  hold  is  just  as  straightforward: 

hx  =  RcS\C2  •  (oi  +  02^2) 

=  0. 

hxX  =  -RcSlSl-{ai+2a2C*^) 

_  Sgn{\)Rcai  yJoj-A 
~  0.2 

which  cannot  be  null  since  Rc  ^  0.  Then  ^  =  Sgn  hxX  —  ~Sgn  (Aeoi).  □ 

5.8  Manipulator  Geometry  Type  B.2:  —  ^  and  \ai\=a2 

As  can  often  be  expected  with  “boundary”  configurations,  we  encounter  degenerate  solu¬ 
tions  of  the  more  general  Cases  B.l  and  B.3. 

Proposition  18: 

For  any  2-dof  manipulator  such  that  its  Denavit-Hartenberg  parameters  satisfy 
^2  =  0  and  |ai|  =  02,  then  there  exists  a  unique  3-tuple  (0:7,  Ay,  Zc-^),  with 

X7  =  (1 Sgn  oi)  •  7r/2  Ay  =  7r/2,  and  Zcy  =  0, 

such  that  for  any  value  of  radius  Rcj,  ff(x.  A;  Zcj^Rcj)  is  equivalent,  in  a  neigh¬ 
borhood  of  (0:7,  Ay)  and  in  a  neighborhood  of  (xy,  —Ay),  to  a  bifurcation  of  codi¬ 
mension  >  4. 

Proof  of  Proposition  18: 

Here  we  have  ay  =  £  •  02  (with  £  =  ±1).  From  Appendix  B,  Case  1.1.2,  we  know 
that,  if  Zc  =  0,  then  for  =  (1  -f  £)  •  7r/2  (so  that  C2  =  -ai/a2  =  -£  and  ^2  =  0)  and 
K2  =  RcCi  =  0,  then  h  =  hx  =  hxx  =  hxxx  =  0,  but  hxxxx  =  6£a^  +  0. 

We  explained  earlier  why  we  want  to  avoid  the  case  Rc  =  0.  The  condition  K2  =  0  is 
therefore  satisfied  only  if  =  0,  that  is,  if  A  =  ql  =  ±7r/2.  The  only  elementary  bifur¬ 
cations  of  codimension  <  3  that  contain  the  term  are  x^  ±  A  and  x^  ±  Ax.  However, 
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it  is  easy  to  verify  that 


hx  =  -R'l  •  C2  •  (ai  +  02(^2)  =  0  and 
hxx  =  —Ki  ■  S2  ■  {a\  +  202^*2)  =  0, 

which  implies  that  codim  A  >  4.  □ 

5.9  Manipulator  Geometry  Type  B.4:  £?2  — 0  fli  =  0 

This  is  another  type  of  manipulator  geometry  that  does  not  seem  suitable  for  hand/eye 
coordination  purposes.  Unfortunately,  this  is  also  the  most  common  geometry  among 
small  robot  arms  used  today  for  hand/eye  coordination  projects. 

Proposition  19: 

For  any  2-dof  manipulator  such  that  its  Denavit-Hartenberg  parameters  satisfy 
<^2  =  0  and  Cl  =  0,  there  exists  a  unique  3-tuple  Z^o), 

2^10  =  — 7r/2,  Ajq  =  7r/2,  and  Z^IO  =  02,  (39) 

such  that,  for  any  value  of  Rc,  H{x,\-,Zciq,Rc)  is  equivalent  in  a  neighborhood 
of  (XjQ,  A^p)  and  in  a  neighborhood  of  (Xj^,  — A^^)  to  a  bifurcation  of  codimension 
greater  than  3. 

Proof  of  Proposition  19: 

This  bifurcation  corresponds  to  Case  1.1.1  of  Appendix  B.  Setting  aj  =  0,  ^2  =  0,  and 
Zc  =  (22  in  the  expression  of  h{q2.,q\),  we  obtain 

^(92,91)  =  G2  ^*2  •  (g2  +  02  52  -  i?c  C*!  C2)  . 

It  is  then  trivial  to  check  that,  for  qi  —  — 7r/2  and  qi  =  ±"/2,  we  get  h  =  hx  =  hxx  =  0, 
but  hxxx  =  3g2  >  0.  The  only  bifurcations  of  codimension  <  3  that  contain  the  term 
are  ±  A  (codimension  1),  x^  ±  Ax  (codimension  2),  and  x^  ±  A^  (codimension  3). 
However,  since  C2  —  0,  it  is  easy  to  verify  that 

hx  =  RcS\a2C2  =  0, 

hxX  =  —2RcS\a2C2S2  —  0,  and 

hxx  =  RcC\a2Cl  =  0, 

which  implies  that  codim  A  >4.  □ 

6.  Discussion  and  Conclusions 

There  are  two  important  aspects  to  the  work  that  I  have  presented  here.  First,  there  is 
the  role  of  the  active  observer  in  a  visual  navigation  problem,  in  terms  of  the  low-level 
controls  as  well  as  in  terms  of  what  I  earlier  called  “intermediate”  or  “topological”  level 
controls  [9].  Next,  there  is  the  aspect  of  skill  learning,  the  skill  being,  in  the  case  that 
concerns  us  here,  reaching.  These  two  issues  will  now  be  addressed. 
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6.1  Active  Vision  and  Task- Specific  Models 

There  is  little  doubt  that  this  work  is  only  a  preliminary  study  of  a  vast  and  complex 
topic.  The  thesis  defended  here  is  that,  just  as  vision  must  be  studied  in  the  context 
of  a  task,  the  needs  and  the  performance  of  the  perceptual  module  must  be  taken  into 
account  in  the  generation  of  the  controls  that  accomplish  that  task.  If  the  robots  are 
to  escape  from  the  laboratories  and  deal  with  the  real  world,  then  it  no  longer  suffices 
to  assume  that  their  sensors  will  faithfully  deliver  measurements,  plus  or  minus  some  a 
priori  uncertainty  estimate.  Somehow,  we  must  find  ways  to  determine  what  constitutes 
a  good  action  of  the  agent  in  terms  of  its  visual  module,  and  how  to  combine  this  with 
the  more  classical,  task-specific  action  selection  (control)  process. 

In  a  previous  paper  [10],  we  proposed  a  quantitative  criterion  that  estimates  the  effect 
of  observer  displacements  on  the  performance  of  (reconstruction)  visual  computations. 
The  study  presented  here  differs  from  it  in  two  important  respects.  First,  because  the 
criterion  by  which  actions  of  the  observer  are  estimated  is  qualitative:  their  effect  on  the 
topology  of  the  PCS.  But  also  because  this  criterion  is  completely  task-specific,  since  it  is 
exclusively  concerned  with  the  hand/eye  coordination  problem.  On  the  other  hand,  these 
approaches  are  similar  in  the  sense  that  they  are  based  on  a  particular  representative 
model:  linear  features  and  a  decomposition  of  the  depth  map  as  a  sum  of  functions  in  the 
case  of  [10],  the  pair  PKM-PCS  in  the  case  of  the  work  presented  here.  The  validity  of 
both  studies  seems  therefore  dependent  on  the  validity  of  their  respective  models. 

This  is  where,  in  my  mind,  the  deepest  difference  between  the  two  approaches  lies. 
Whereas  the  “linear  features”  and  depth  map  are  little  more  than  convenient,  artificial 
elements  of  the  mathematical  model  in  [10],  I  believe  that  the  PCS,  in  one  way  or  another, 
captures  some  essential  information  about  the  hand/eye  coordination  process.  A  case 
could  be  made  against  the  choice  of  a  camera  space  generated  by  the  coordinates  of 
image  point  features,  a  fortiori  of  a  single  image  point,  but  this  concern  is — to  some 
extent — addressed  in  [3],  where  a  different,  more  robust  type  of  visual  feedback  is  used 
by  the  controller,  with  similar  results.  There  may  be  a  better  camera  space  to  work  from, 
but  the  methodology  of  this  approach  and,  most  likely,  its  results  would  remain  valid. 

6.2  Active  Vision  and  Skill  Learning 

The  issue  of  skill  learning  per  se  has  not  been  addressed  in  this  first  part  of  the  report. 
The  task  that  we  have  undertaken  here,  and  will  complete  in  Part  II,  is  to  establish  a 
complete  chart  of  the  topological  structure  of  the  PCS:  since  a  mathematical  model  of 
the  object  we  want  to  “learn”  is  available  to  us,  we  begin  first  by  determining  what  it 
can  look  like.  At  the  end  of  Part  I,  we  now  have,  for  any  possible  geometry  of  a  2-dof 
manipulator,  a  list  of  organizing  centers.  This  tells  us  what  the  singularities  of  the  PKM 
can  be  expected  to  look  like.  In  Part  II  of  this  report,  we  will  give,  for  each  of  these 
organizing  centers,  and  whenever  it  is  at  all  possible,  a  universal  unfolding  expressed  in 
terms  of  the  camera  pose  parameters,  as  well  as  the  equations  of  its  transition  set.  In 
other  words.  Parts  I  and  II  together  give  us  a  complete  description  and  list  of  all  possible 
effects  of  observer  displacements  on  the  topology  of  the  PCS. 

Part  III  of  this  report  is  intended  to  be  a  “User  Manual,”  rather  than  a  technical 
discussion  of  the  behavior  of  the  PCS.  There,  I  will,  for  each  type  of  2-dof  manipulator 
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geometry,  give  the  “family  portrait”  of  all  possible  types  of  bifurcation  diagrams  (i.e.,  the 
diagram  of  singularities  in  the  joint  space)  and  resulting  PCS.  Finally,  we  will  see  how 
this  information  can  be  exploited,  together  with  information  collected  by  the  low-level 
controller,  to  learn  the  shape  of  the  PCS. 
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APPENDIX  A:  Bifurcations 


A.l  Definition 

Let  us  consider  a  smooth  function  g  ;  and  the  equation 

g{x,X)  =  0.  (A.l) 

The  locus  of  solutions  of  (A.l)  is  called  the  bifurcation  diagram  of  the  equation,  while 
X  and  A  are  its  variable  and  bifurcation  parameter.  For  each  Aq,  n(Ao)  is  defined  as  the 
number  of  x’s  such  that  ^(x,Ao)  =  0.  A  solution  (xo,Ao)  of  (A.l)  is  called  a  bifurcation 
point  if  n(A)  varies  in  the  neighborhood  of  Aq.  For  example,  there  are  three  bifurcation 
points  in  the  bifurcation  diagram  shown  in  Figure  A.l. 


n  (A)  2343  2  1  0 


Figure  A.l  —  An  example  of  bifurcation  diagram 

A  necessary  condition  for  the  existence  of  a  bifurcation  can  be  expressed  mathematically 
as  follows; 

g{x,X)  =yi(x,A)  =  0. 

The  motivation  for  studying  the  bifurcations  of  problems  such  as  (A.l)  is  that  it  is  about 
such  points  that  interesting  changes  in  the  shape  of  the  bifurcation  diagram  can  and  will 
occur  when  the  system  is  perturbed  under  the  action  of  some  parameters  such  as,  in  the 
case  that  interests  us  here,  the  pose  of  the  camera  relative  to  the  manipulator. 

A. 2  Unperturbed  vs.  perturbed  bifurcations 

In  the  neighborhood  of  a  bifurcation  point,  the  initial  function  can  be  replaced  by  its 
Taylor  expansion  and  then  identified  with  one  of  the  elementary  bifurcations.  For  example, 
g{x,  A)  could  be  locally  equivalent  to  the  simple  bifurcation  defined  about  (xq,  Aq)  =  (0, 0) 
by  the  equation  x^  —  A^  =  0.  This  equation  admits  as  solutions  the  lines  having  equations 
X  =  A  and  x  =  —A. 

This  is,  however,  only  the  solution  of  the  unperturbed  bifurcation  (its  normal  form) 
that  we  are  describing  here.  In  practice,  this  solution  cannot  be  observed  since — hopefully. 
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small — error  terms  originating  either  in  the  system,  the  measuring  apparatus,  or  even 
the  model  itself  are  inevitably  added  to  the  state  equation.  It  is  immediately  verified 
that,  if  we  add  an  arbitrarily  small  constant  term  to  the  equation  of  the  simple  bi¬ 
furcation  problem,  important  changes  in  the  topology  of  the  bifurcation  diagram  will 
occur.  Figure  A. 2  shows  the  persistent  bifurcation  diagram  of  the  simple  bifurcation 
(x^  —  -f  a  =  0)  and  of  another  bifurcation  that  we  will  encounter  later  in  this  paper: 
the  isola  {x^  -f  A^  -f  a  =  0). 


(a)  (b) 


Figure  A. 2  —  Persistent  bifurcation  diagrams  of  two  elementary  bifurcations  (from  [7]): 

(a)  The  simple  bifurcation:  -f  q  =  0 

(b)  The  isola:  A*  q  =  0 

Although  the  perturbed  bifurcation  diagrams  look  different  from  the  unperturbed 
diagram,  there  is  little  doubt  that  the  latter  is  the  key  to  understanding  how  the  system 
passes  from  a  perturbed  diagram  form  to  another.  The  central  idea  of  the  approach 
presented  in  [7],  and  which  we  follow  here  in  this  study,  is  that  for  a  large  number 
of  bifurcation  problems  it  is  possible  to  recognize  that  organizing  center  and  use  that 
knowledge  to  predict  the  possible  perturbed  bifurcation  diagrams  that  can  be  measured 
for  the  real  system. 

For  some  highly  degenerate  bifurcation  problems,  very  complex  topological  changes 
can  occur  as  an  effect  of  arbitrarily  small  perturbations.  No  matter  how  complex  these 
changes,  they  will  be  combinations  of  the  four  basic  phenomena  shown  in  Figure  A. 3.  We 
see  for  example  that  the  simple  bifurcation  and  the  isola  bifurcation  are  each  composed 
of  a  single  basic  phenomenon.  Other  bifurcations  that  we  shall  encounter  in  this  study, 
however,  are  significantly  more  complex. 

A. 3  Universal  unfoldings 

Figure  A. 2  showed  the  effect  of  adding  a  small  constant  perturbation  term  to  the  equation 
of  the  simple  bifurcation.  A  natural  question  to  ask  is  if  other  types  of  perturbations 
would  result  in  different  bifurcation  diagrams.  What  if  we  were  to  study  the  solution 
of  X"  —  A“  -f  Q  +  /9a;  =  0  or  O'-  —  A"  +  7  ■  sin  x  =  0  for  small  values  of  /?  or  7?  It  turns  out 
that,  in  this  particular  case,  the  persistent  bifurcation  diagram  would — qualitatively — be 
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Isola 


Bifurcation 


Hysteresis 


Double  Limit  Point 


Figure  A.3  —  The  four  basic  non  persistent  phenomena 

the  same  since  we  are  already  dealing  with  a  universal  unfolding  of  the  normal  form  in 
the  first  place.  [7]  defines  a  k-parameter  unfolding  of  g{x,  A)  as  a  germ 

G  :  IR^  X  ^  IR 

(a:,A;a)  i — ^  G{x,X;a), 


such  that 

G(x,A;0)  =  g{x,X). 

In  other  words,  an  unfolding  G{x,X;oi)  of  ^(x,A)  is  a  perturbation  of  5'(x,A),  with 
a  =  (ai, . . .  ai)  as  the  vector  of  perturbation  parameters.  An  universal  unfolding  of  g 
is  defined  as  an  unfolding  G  oi  g  such  that  every  other  unfolding  of  g  factors  through 
G  and  no  other  unfolding  of  g  has  fewer  perturbation  parameters  than  G.  The  number 
of  parameters  of  G  is  then  a  characteristic  of  the  bifurcation  problem,  and  is  called  the 
codimension  of  g.  Note  that  a  germ  g  may  have  more  than  one  universal  unfolding,  in 
which  case  [7]  chooses  the  one  with  the  lowest  order  (which  may  not  necessarily  be  the 
one  in  which  the  perturbation  parameters  have  the  most  physical  meaning). 

A.4  The  Transition  Set 

Once  a  universal  unfolding  G(x,  A;  a)  of  g{x,  A)  is  defined  the  space  W  C  IR^  of  perturba¬ 
tion  parameters  a  =  (oji,.  •  -ctfc)  can  be  decomposed  into  regions  for  which  qualitatively 
different  bifurcation  diagrams  can  be  observed.  Figure  A. 2  gave  examples  of  this  in  the 
case  of  1-parameter  unfoldings. 

For  any  bifurcation  problem  for  which  a  universal  unfolding  G{x,  A;  a)  is  known,  the 
space  of  perturbation  parameters,  W,  is  partitioned  by  the  transition  set  of  the  bifurcation, 
S,  which  [7]  defines  as  follows: 


E  =  Bunuv, 


(1) 


Figure  A. 4  —  Persistent  perturbations  of  the  pitchfork  bifurcation  -  Ax  +  a  +  =  0. 

where  and  V  are  the  subsets  of  W  that  contain  those  values  of  the  perturbation 

terms  for  which  the  bifurcation  (grouped  together  wuth  the  isola),  hysteresis  and  double 
point  limit  phenomena,  respectively  can  be  observed.  In  other  terms, 

B  =  |ck:  €  :  3(3:,  A)  €  IR^  such  that  G  =  Gx  =  G\  —  ^  hi  (x,  A;  a)|. 

=  |q;  G  IR^  :  3(x,  A)  €  IR^  such  that  G  =  Gx  =  Gxx  =  0  at  (x,  A;  a)|. 

=  |q  €  [R^  :  3(xi,X2,A)  €  IR^,  xi  ^  xo  such  that 

(?  =  =  0  at  (xf,  A;  a),  i  —  1, 2j. 

We  can  now  enunciate  the  rather  remarkable  main  theorem  of  this  singularity-based  ap¬ 
proach  to  the  stud}^  of  bifurcations: 

Main  geometric  theorem: 

Let  G  :  U  X  L  X  W  — >  [R  be  a  family  of  bifurcation  problems  satisfying 

G{x.  A,  q)  7^  0  V(x,  A,  q)  €  dU  xLxW. 

Let  a  and  jd  be  in  the  same  connected  component  of  W  ~  E.  Then  G(  •  ,  •  ;  ct) 
and  G(  •  ,  •  ;  /?)  are  globally  equivalent  on  U  x  L. 

A. 4.1  Some  Elementary  Perturbed  Bifurcations 

A. 4. 1.1  The  pitchfork  bifurcation 

The  pitchfork  is  a  bifurcation  of  codimension  2,  which  exhibits  three  different  basic  phe¬ 
nomena:  two  hysteresis  points  and  one  simple  bifurcation.  Figure  A. 4  shows  the  transition 
set  for  this  bifurcation,  as  well  as  the  types  of  persistent  bifurcation  diagrams  that  can  be 
expected  from  experimental  measurements.  For  completeness’  sake,  bifurcation  diagrams 
theoretically  observed  along  branches  of  the  transition  set  are  given  as  well. 
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A.4.1.2  The  “swallowtail”  bifurcation 

Although  the  name  “swallowtail”  is  in  fact  not  used  in  [7],  we  will  use  it  here,  since  the 
transition  set  of  this  bifurcation  center  is  the  surface  representative  of  the  classical  catas¬ 
trophe  of  the  same  name  (Figure  A. 5).  The  swallowtail  is  a  bifurcation  of  codimension  3, 
which  exhibits  two  simple  bifurcation  phenomena. 


(1)  above  the  (0)  -*  critical 


Figure  A. 5  —  Persistent  perturbations  of  the  “swallowtail”  bifurcation  -  Xx  +  a  +  fSx  =  0. 


A.4.1.3  The  quartic  fold  bifurcation 

The  quartic  fold  is  a  bifurcation  of  codimension  3  that  exhibits  two  kinds  of  basic  phe¬ 
nomena:  double  limit  point  and  hysteresis.  Figure  A.6  shows  the  transition  set  for  this 
bifurcation,  as  well  as  the  types  of  persistent  bifurcation  diagrams  that  can  be  expected 
from  experimental  measurements. 


(3) 


Figure  A.6  —  Persistent  perturbations  of  the  quartic  fold  bifurcation  -  A  -f  ax  -f-  /?x^  =  0. 
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APPENDIX  B:  Various  Derivations 


B.l  Choosing  the  Right  State  Variable 

We  have  seen  in  Subsection  4.2  that  the  condition  for  the  existence  of  a  singularity  for  a 
given  joint  configuration  91,92)  could  be  expressed  in  the  following  form: 


^(91,92) 


0-l0,2  +  (^1  +  <^2  d”  ^2)  ^2  +  0.\ZcS2  +  CLia^C^  +  n2-^cC’2>S'2j  + 
{—aiXc  —  d2Yc)  C2  —  aiXcC^  ■  C\  + 

\-aiYc  +  d2Xc)  C2  -  a2YcCl]  -Si  =0, 


or 

9(91192)  =  00  +  /3i  ■  Cl  +  02  -  Si  =0, 

where  the  0i  are  functions  of  the  second  joint  variable,  parameterized  by  the  camera  pose 
parameters. 

If  we  treat  91  as  the  state  variable  and  92  as  the  bifurcation  parameter  of  a  bifurcation 
problem,  then  a  necessary  and  sufficient  condition  for  a  joint  configuration  (91,92)  to 
correspond  to  a  bifurcation  point  is  that 

9(91192)  =  00  +  01  ■  Cl  +  02  ■  Si  =  0 

^^(91192)  =  02  •  Cl  -  01  •  Si  =0. 

It  is  then  trivial  to  verify  that  a  necessary  condition  for  these  equations  to  hold  is 
that  0Q  =  0j  +  02-  The  second  partial  derivative  of  g  with  respect  to  91  is  then 


9ix(9ii92)  =  -01  ■  Cl  -  02  ■  Si  =  0Q  -5^(91,92), 


so  g  and  its  first  two  partial  derivatives  with  respect  to  the  state  variable  are  zero  if  and 
only  if  0Q  —  01  =  02  =  0.  In  other  words,  if,  for  a  particular  pose  of  the  camera  and  value 
of  second  joint  angle,  92  =  92,  g{qi-,qV)  =9i(9ii92)  =  9ii(9ii92)  =  0i  then  this  means 
that  9(  •  ,  92)  is  the  null  function,  which  is  not  a  very  interesting  function  to  talk  about. 


B.2  Case  Study  of  h  and  Its  Bifurcations 

B.2.1  Introduction 

Note  that  the  decomposition  into  cases  is  different  here  from  the  one  presented  in  Section  5, 
as  the  question  we  are  trying  to  answer  can  be  approximated  as  follows:  “How  can  we  pick 
all  the  parameters  and  variables  so  as  to  set  as  many  derivatives  of  h  as  possible  to  zero.” 
Section  5  not  only  summarizes  the  results  obtained  here,  but  also  sorts  out  configuration 
parameters  and  variables  in  order  to  base  the  presentation  on  the  type  of  the  manipulator 
(i.e.  on  the  relative  value  of  its  DH  parameters). 
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We  mentioned  in  Section  5  that  S2  and  Zc  appear  in  the  expression  of  h  only  when 
multiplied  by  each  other  so  that  H{q2,qi:  Zc,Rc)  =  H{—q2,qi;—Zc,Rc)-  As  a  conse¬ 
quence,  we  can  restrict  our  study  of  the  perturbed  bifurcations  of  h{q2-,qi)  to  the  case 
Zc>0,  knowing  that  the  topology  for  the  other  half  can  be  built  by  simple  symmetry. 

Finally,  since  V{Ki,K2)  €  IR*^,  3!(i?c,9i)  €  K.  x  [0,27r]  such  that  ki{qi)  =  Ki  and 
^2(91)  =  K2,  we  will  be  able  treat  ki{qi)  and  k2{qi)  as  the  unknowns  of  the  system  of 
linear  equations  defined  by  the  conditions  defining  the  existence  of  a  bifurcation,  h  —  0 
and  hx  “  0. 


((^2(72)  ■  Ki  —  (oi  +  CL2C2)  C2  •  K2  —  —  (ai  +  C12C2)  •  ^3(92)  (^A) 

—  (d2S2)  •  K\  d-  (ui  4-  202^72)  S2  ■  K2  =  0,282  •  ^3(92)  —  (fli  +  02C2)  •  ^3(92)  (B.2) 

The  determinant  of  this  linear  system  is 

D2  =  <120282  •  +  202(72)  —  <120282  •  (oi  +  (12O2) 

=  a2<^2(72‘S'2. 


Our  study  can  therefore  be  decomposed  into  4  cases  that  will  be  addressed  in  Sections  B.3 
through  B.6: 

1.  d2  =  0, 

2.  d2  ^  0  and  O2  =  0, 

3.  ^2  7^  0  and  82  =  0, 

4.  d2  ^  0,  O2  ^  0,  and  82  7^  0. 

But  first  we  need  to  obtain  a  general  expression  for  the  partial  derivatives  of  arbitrary 
order  of  h  with  respect  to  92- 

B.2.2  Derivatives  of  h  with  respect  to  q2 

Since,  as  we  shall  see  later,  cases  ci  =  0  and  C2  =  0  play  an  important  role  in  our  study, 
we  rewrite  h(qi,q2)  as: 


^(9l:  92)  =  oi  ■  (ks  (92)  —  O2  ■  K2)  +  O2  ■  {0,2  ■  kz  (92)  —  020*2  •  K2  +  d2  •  K\) 


In  order  to  compute  the  nth  partial  derivative  of  ^(51,92)  with  respect  to  ^2,  we  must 
proceed  separately  with  cases  where  n  is  even  and  cases  where  n  is  odd. 
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•  If  n  =  2p,  with  j9  >  0 


d'^P  h 

(^3  (92)  -  C2  ■  K2)  + 

oq2 

d'^p 

—2-  {C2  •  (02  •  h  (92)  -  (12C2  ■  K2  +  d2-  Ki)) 

oq2 

=  m  ■  ((-ir'  ■  (<12  -  h  {12))  +  (-I)"-’  ■  C2  ■  K2)  + 

£  (  •  )  ■  ;^  (^2)  •  2p-t  ("2  •  ^3  (92)  -  02^2  •  K2  +  d2  ■  Ki) 
i=0  V  ’  /  "92  ^92 

=  (  —  1)^  ^  ai  •  (a2  -  h  (92)  +  (^2  •  K2)  + 

p  ■  /2n\  ^2p-2j 

(  0-  )  ■  ^3  •  2p-2i  (^2  •  h  (92)  -  02(^2  •  ir2  +  C?2  •  4- 

j=0  V  /  ^q2 

^0  (27  +  1)  '  ’  ^^2p“2j-l  (^2  •  ^3  (92)  -  a2<^2  •  K2  +  d2-  Ki) 

=  {-lY+\l-{a2~ks{q2)  +  C2-K2)  + 

(-1)^  C2  •  (02  •  h  (92)  -  O2C2  •  A'2  +  (f2  •  i^l)  + 

(-1)"+'  •  02(72  •  (02  -  h  (92)  +  C2-K2)-  E  f  +  (B.3) 

2=0  V‘^7/ 

(-1)”  «252  •  [k'2  (<!2)  +  S2  ■  A2)  ■  (2/^  J 


•  If  n  =  2p  +  1,  with  p  >  0 


=  0i  • 


52?+ 1 

^2p+l 


(^3  (92)  —  C2  ■  K2)  + 


dq, 


2+lp 


{C2  •  (02  •  ^3  (92)  ~  02(72  •  A2  +  C?2  ■  Ah)) 


—  Gi  •  ((—1)^  ■  ^3  (92)  4-  (— 1)^  •  *52  •  A'2]  + 


It  (C'2)  •  ItoI  (“2  ■  («)  -  “2C'2  ■  A2  +  <i2  ■  AT) . 

"42  ^42 
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We  finally  obtain 


=  (-l)”  ■  a,  .  [W,  (,2)  +  S2  ■  A-2)  + 

0q2 

P  •  /9n  -I-  1  \  ,92p-2j+l 

E  (-1)'  ■  (  2I  ]  ■  ■  ^pFFT  .  ir2  +  *  •  ifi)  + 

■  (sj  + 1 )  ' 

=  (-1)^  •  01  •  (52)  +  S2  ■  K2)  + 

(— S2  •  (02  •  ^3  (92)  —  02^2  •  1^2  +  c?2  •  -^l)  + 

(-1)^  02(72  •  (A;3  (92)  +  S2  ■  K2)  ■  ^2j  j  +  (B.4) 

(-1)^  02^2  •  (02  -  h  (92)  +  C'2  •  ii^2)  •  13  ^2;  +  1)  ■ 

B.3  Case  1: 

The  linear  system  simplifies  to 

(01  +  02(72)  C2  •  K2  =  (ai  +  02(72)  •  k'i{q2)  (B-5) 

(01  +  202C2)  S2  ■  K2  =  0,282  •  ^3(92)  ~  (®i  +  02C2)  ■  ^3(92)  (B.6) 

An  obvious  necessary  condition  for  the  existence  of  a  solution  to  the  redundant  system  of 
equations  {A  •  K2  =  B,  C  ■  K2  =  -D}  is  that  A  -  D  =  B  ■  C: 

(01  +  02(72)  •  C2  ■  [0282  ■  {02  +  01^72  +  Zc82)  —  (ai  +  a2C'2)  •  (— ai5'2  +  Zc82)]  = 

(oi  +  202(72)  ■  82  ■  (oi  +  02C2)  ■  {02  +  01C2  +  Zc82) 

Developing  this  necessary  condition  gives 

02(72^2  ■  (oi  +  02C2)  •  (02  +  Oi(72  +  Zc82)  —  C2  '  (ctl  +  02(72)^  •  (— Oi5'2  +  Zc82)  = 
020282  ■  (01  +  02C2)  •  (02  +  O1C2  +  Zc82)  +  82  ■  (01  +  02(72)“  •  (02  +  O1C2  +  Zc82) 

=>  C2  ■  (oi  +  OoCo)^  •  {0182  —  Zc82)  =  82  •  (01  +  02(72)^  •  (02  +  01C2  +  Zc82)  , 
or 

(oi  +  02(72)^  •  {Zc  A  0282)  =  0, 
which  allows  us  to  further  divide  the  problem  into  subcases. 
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B.3.1  Case  1.1:  d2  =  0  and  a]^+a2-C2  =  0  (only  possible  if  |aj  <^2) 

From  (B.6),  we  obtain  a2C2S2  •  K2  —  0282  ■  (02  +  aiC'2  +  ZcS2),  so  that  we  have  again  to 
distinguish  subcases. 

•  Case  1.1.1:  ^2  =  0,  ci  +  026*2  =  0,  and  C2  =  0  (and  therefore  oi  =  0). 

Then  =  £7r/2  and  82  =  e  —  ±1.  From  (B.6)  we  get  Zc  =  — 025*2,  so  that  e  =  — 1, 
92  ~'^/2,  and  Zc  =  02.  A  Taylor  expansion  of  h{q2,qi)  in  the  neighborhood  of 

92*  =  £7r/2,92  =  92*  +  dq2  gives 


h{q2*  +  dq2)  =  a2  ■  K2  ■  dq2^  —  -a\  ■  dq2^  +  o{dq2^). 

If  we  choose  K2  =  0,  then  we  can  get  the  second  derivative  of  h  with  respect  to  52  to 
be  null  as  well,  but  the  third  derivative  cannot  be  equal  to  zero. 

•  Case  1.1.2:  d2  =  0,  oj  +  026*2  =  0,  and  52  =  0  (and  therefore  oi  =  ±02) 

Then  q2*  =  Q  or  q2*  —  tt  and  6*2  =  £  =  — Sgn  oi  =  ±1.  A  Taylor  expansion  of  h(q2, 91) 
in  the  neighborhood  of  q2*  gives: 


h{q2*  +  dq2)  —  02/5^2  •  dq2^  —  -02^0  •  dq2^  —  ^  •  (6c02  +  7a2Zc')  dqo^  +  0(^92*^). 


If  we  choose  K2  =  0  and  Zc  =  0,  we  can  get  the  second  and  third  derivatives  of  h  with 
respect  to  92  to  be  null  as  well,  but  the  fourth  derivative  then  cannot  be  set  equal  to 
zero. 

•  Case  1.1.3:  ^2  =  0,  oi  +0262  =  0,  62  ^  0,  and  52  7^  0  (and  therefore  0  <  |oi|  <  02). 
Then  6*0  ~  and  80  =  £(02  —  Ci)^^^/o2,  so  that,  substituting  in  (B.6),  we 

obtain  for  K2' 

iq  =  ^  •  (o|5|  +  Zc  •  52) 

al-al  ^  yj4-a\ 

—  —  e  ■  Zjc  '  • 

Ol  Oi 

We  use  the  expressions  of  62 ,  51,  and  K2  to  compute  the  value  of  the  second  derivative 
of  h  with  respect  to  92: 


d-h 

dql 


3qiQ2  —  ‘1(128.2  d”  ~2  '  { — 3ctj  T  30.^82  "b  3(i\\J~q 
0-2  ^ 

2^2  "b  l£(l2\J O2  —  of  ■  Zc 


—2a\a2  + 


Ol 
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In  order  to  set  this  derivative  to  zero,  one  must  have  Zc  =  —  af,  which  means 

that  £  =  —  1  and  K2  =0),  but  the  third  derivative  of  h  with  respect  to  q2  is  then 


h 

dql 


which  cannot  be  null. 

B.3.2  Case  1.2:  ^2  =  0?  ai+a2-C2  =  0,  and  +  02  -52  =  0 

We  can  divide  by  ai  +  02  •  C2  on  both  sides  of  (B.5)  to  get  C2  K2  =  ^3(92),  which  leads 
to  another  decomposition  into  two  subcases: 

•  If  (72  7^  0,  then  C2  •  K2  =  ^3(92)  =  02  +  aiC'2  +  ZcS2  K2  =  ai  +  02(72- 

•  If  ^2  =  0  (that  is,  if  Zc  =  02),  then  S2  =  -1  and  ^3(^2)  =  0,  so  that  Equation  (B.6) 
simplifies  into  K2  —  o-l 

So  we  get  in  fact  the  same  solution  for  K2  in  both  cases,  but  the  expression  for  the  second 
derivative  of  h  with  respect  to  52  is  then  equal  to  02  •  (oi  +  0.202),  which  cannot  be  zero. 


B.4  Case  2:  d2^0  and  C2  =  0 

Since  C2  =  0,  we  must  have  q2  =  e  •  7r/2  {e  =  ±1)  and  S2  =  £•  Then  ^3(92)  =  <^2  + 
^3(92)  =  linear  system  takes  the  following  form: 

0  •  Ki  +  0  •  K2  =  — oi  •  (02  +  £  •  Zc)  (B-7) 

— e  •  d2  ■  Ki  +  £  •  oi  •  K2  =  £  •  (of  +  of)  +  a2Zc  (B-8) 


We  see  from  (B.7)  that  we  must  distinguish  two  subcases:  ai  =  0  and  01  7^  0, 02+£-.^c  —  0. 

B.4.1  Case  2.1:  d2^0,  €2  =  0,  and  ai  =  0 

The  general  expressions  for  derivatives  of  arbitrary  order  of  h  with  respect  to  92  then 
simplify  to 


dqf 

h 

dql"*' 


=  (— e  ■  (02  (02  +  eZc)  +  d2  ■  Ki)  + 

(-1)^£  •  {a2Zc  +  £02  •  1<2)  ■  XI  ^2;  +  1 


It  is  then  obvious  that  if  Zc  =  0,  K2  =  Oj  and  Ki  =  —a\ld2,  then  all  derivatives  of 
arbitrarily  high  order  of  h  with  respect  to  q2  are  null  (we  shall  see  with  Case  4.1  that  this 
is  fact  just  just  a  particular  case  of  a  very  degenerate  configuration). 
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B.4.2  Case  2.2:  ^2^0?  ^'2  =  0,  and  a2  +  £-Zc  =  0 

Then  Zc  =  02,  e  =  —1,  and  (B.8)  simplifies  to 

d2-  K\—  a\-  K2  =  —aj.  (B.9) 

In  this  case,  dh? Jdq^  =  3gi  •  02  —  2a2  •  K2.,  so  we  can  get  the  first  three  terms  of  the 
Taylor  expansion  of  h  to  be  zero  if  and  only  if  we  have  Kf  =  a\l2d2  and  K2  =  3ai/2. 
However,  the  third  derivative  of  h  with  respect  to  52  is  then  which  cannot  be  equal 
to  zero. 

We  must  mention  here  an  interesting  peculiarity  of  ^(92,91),  in  the  neighborhood  of 
this  organizing  center,  that  results  in  a  more  complex  bifurcation  diagrams,  and  that  had 
to  be  taken  into  account  in  Section  5.  For  the  same  values  of  Z*,  R*,  and  92,  another, 
less  complex,  bifurcation  can  be  observed.  Indeed,  there  is  another  value  of  q\  for  which 
and  k2{qi)  are  solutions  of  (B.9): 

d2K\  —  aiK2  =  —a\. 

Once  expressed  in  terms  of  qi ,  this  equation  becomes 

<^2  d2R*Si  —  <i\R*(.C\  —  — of, 
or 

aiCi-d25i  =  =  L.  (B.IO) 

The  angles  q\  and  5**  that  are  solutions  of  (B.IO)  correspond  to  the  intersection  of  the 
circle  of  center  (0, 0)  and  radius  L  with  the  circle  whose  diameter  is  defined  by  the  points 
(0,0)  and  (ai,  — 0^2)  (and  in  turns  defines  angle  p),  as  shown  in  Figure  B.l. 


Figure  B.l  —  The  two  solutions  of  (B.9) 
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There  is  an  obvious  symmetry  with  respect  to  the  direction  of  angle  p:  q\—p  =  p—qT- 
Using  the  values  computed  earlier  for  and  K2,  it  is  then  easy  to  verify  that 


cos  ql*  = 


Ql 

2Rl 


and 


sin^i*  = 


£l|  -|-  2(^2 

’  2d2Rt  ' 


that  is,  =  —a\l2d2  and  K2*  —  gi/2. 


B.5  Case  3:  d2^0  and  ^2  =  0 

Since  S2  —  0,  we  must  have  =  (^  ~  ^)  ‘  =  il)  therefore,  €2=6, 

kz{q2)  =  a2  +  eoi,  and  k'^iq^)  =  e-^c-  The  linear  system  then  takes  the  following  form: 

e-  d2-  Ki  -  £(ai  +  £02)  •  K2  =  -(ai  +  £122)  •  (02  +  e^i)  (B-11) 

0  ■  Ki  +  0  ■  K2  =  —e{ai  +  £02)  •  Zc  (B.12) 

From  Equation  (B.12)  we  see  that  we  must  must  decompose  Case  3  into  two  subcases: 
ai  +  £02  =  0  and  oi  +  £02  ^  0,  Zc  =  0. 

B.5.1  Case  3.1:  ^2^0?  ‘S'2  =  0?  and  ai+E-a2  =  0 

From  the  first  equation  we  deduce  that  Ki  =0  (since  ^2  ^  0).  If  we  set  JTi  to  zero,  then 
the  Taylor  expansion  of  h  in  the  neighborhood  of  becomes 

h{q2  +  dq2)  =  -K2  •  dql  ~  2^2^c  •  dq2  -  •  (6£a2  -  '^Kl)  ■  dqj  +  o{dq2). 

If  Zc  =  0  and  K2  —  0,  then  the  second  and  third  derivatives  are  null  as  well,  but  the 
coefficient  of  the  fourth  order  term  is  then  —ealli,  which  cannot  be  zero. 


B.5.2  Case  3.2:  ^2^0,  82  =  0,  |ail  ^a2,  and  1^  =  0 

Since  q2  =  {1  -  £)7r/2,  we  have  kz{q2)  =  02  +  eoi  and  ^3(92)  =  =  0.  The  general 

expressions  for  derivatives  of  arbitrary  order  of  h  with  respect  to  52  then  simplify  to 


h 

'd^ 

dqf 


=  0  Vp  >  0, 


=  (—1)^  ea\  •  (ci  —  K2)  +  (”1)^  •  (02  +  d2K^  + 


{-\Ya2  ■  (ai  -  K2)  +  (-1)'’£G2  •  (ai 


•  Case  3.2.1:  ai  =  0 

It  is  then  obvious  that,  for  K2  =  0  3,nd  K\  =  — a2/<^2?  d  and  its  partial  derivatives 
of  arbitrarily  high  order  with  respect  to  52  are  equal  to  0  (we  shall  see  with  Case  4.1 
that  this  is  fact  just  just  a  particular  case  of  a  very  degenerate  configuration). 


65 


•  Case  3.2.2:  ai  0 

In  this  case, 

£  ((ai  +  £02)^  +  ^2  •  it'l  -  (ai  +  £02)  • 

((«i  +  +  d2-  Ki  -  (gi  +  2£a2)  •  K2) 

£  ,  ,  .  0.2 

“2  ^(92,91)  +  —■K2. 

So,  in  order  for  the  second  derivative  to  be  zero,  one  must  have  K2  =  0  and  then 
the  condition  h  —  0  implies  that  Ki  =  — (gi  +  £a2)^/d2.  However,  the  fourth  partial 
derivative  of  h  with  respect  to  52  is  then  equal  to  601^2  7^  0. 

Function  h  exhibits  here  the  same  type  of  “peculiar”  behavior  that  we  had  reported 
in  Case  2.2:  For  the  same  values  of  a:  =  Z*,  and  i?*  that  we  just  calculated,  there 

is  another  value  of  A  =  51,  for  which  another,  less  complex,  independent  bifurcation 
can  be  observed.  In  this  case,  it  is  Equation  (B.ll),  expressing  the  condition  A  =  0, 
that  admits  another  solution  (Kl*,K2*)  with  the  same  value  for  Rc,  R^*  =  R*,  as 
that  of  the  “main”  solution, 

ed2Ki  -  £  •  (fli  +  £02)  •  K2  +  (gi  +  £G2)  •  (02  +  £Gi)  =  0. 

Once  expressed  in  terms  of  51,  this  equation  becomes,  after  dividing  on  both  sides  by 

(gi  +  £G2)  •  R*Ci  —  d2RcSl  —  (G]  4*  £G2)^  +  <^2, 


h{<l2,qi)  = 

dH  _ 
dql  ~ 


or 

(gi  +£G2)  •  Cl  -  dsFi  =  +  ^  (g  13) 

Rc 

The  construction  that  gives  us  angles  ql  and  q**,  the  solutions  of  (B.13),  is  similar  to 
the  one  we  gave  in  Case  2.2.  Angles  ql  and  ql*  correspond  to  the  intersection  of  the 
circle  of  center  (0,0)  and  radius  |d2|  with  the  circle  whose  diameter  is  defined  by  the 
points  (0,0)  and  (gi  -f  £02,— ^2)  (and  in  turns  defines  angle  p'^).  There  is  an  obvious 
symmetry  with  respect  to  the  direction  of  angle  p'^:  ql  —  p'e  =  p'e  ~  pT •  Using  the 
values  computed  earlier  for  KI  and  A'^,  it  is  then  easy  to  verify  that 


cos  ql* 


2|d2l  •  (gi  -f  £G2)  ,  .  **  Sgn(d2)-  ((Gi+£a2)2-d|) 

/  \o  79  s.nQ  sin  —  \9  79 

(nj  ~h  CO. 2)  “(“  (cEi  “t"  502)^  d^ 


that  is. 


KV  = 


(gi  +  £G2)“  —  dl 

T2 


and  Kl*  =  2(gi  +  £02). 
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B.6  Case  4:  d2^0,  €2^0^  and  529^=0 

B.6.1  Solution  of  the  linear  system 

The  determinant  of  the  2  x  2  linear  system  D2  =  d2CjS2  is  not  equal  to  zero.  We  can 
easily  compute  the  solution  for  Ki  =  ki{qi)  and  K2  =  ^2(51)  expressed  as  functions  of  92 
and 


Ki  = 


K2  = 


—  (oi  +  02(^2)^  •  (Zc  +  0,282) 

02^2(71 5'2 

(B.14) 

OiZc  +  02^0(7!  +  01025*2 

02(71^2 

(B.15) 

There  are  obviously  an  infinity  of  combinations  of  values  for  Zc,Rc,  Qi  and  q2  such  that 
(B.14)  and  (B.15)  are  verified.  Since  we  are  looking  for  an  organizing  center,  we  have  to 
look  for  the  combination  that  leads  to  the  most  singular  topology  for  h.  We  therefore 
substitute  the  values  given  by  (B.14)  and  (B.15)  in  the  expression  for  the  second  derivative 
of  h  relative  to  52-  The  equation  h^x  =  d'^hldq2^  =  0  gives  us  a  condition  allowing  us  to 
compute  Zc  as  a  function  of  q2'. 

’2ai  -  SuiCl  -  a2Cl'\  ^  ,  2aia25'|  ^ 

We  notice  that  since,  in  the  case  we  are  treating  here,  ^2  0  and  6*2  ^  0,  the  equation 

has  no  real  solution  for  Zc  when  2ai  -  SaiCl  -  02^!  =  0.  Reporting  the  solution  of  this 
linear  equation  in  (B.14)  and  (B.15)  gives  new  expressions  for  K2  and  Ki  as  well: 


201025'! 

— 2oi  -j-  SoiC*!  ”t”  ^2^*2 

_ +  ^2^2)^ - ^ 

3,2  ^2ai  —  3oiC*2  ~  02^*2) 

3oi  (01  +  02C'2)  Si 

2oi  —  301C2  —  02(72 

We  substitute  these  values  in  the  expression  for  d^hldq2^  to  get  a  new  condition,  which 
this  time  only  depends  on  q2'- 

d^h  _  60102  (Q2  +  «lC'2)  S2  _  Q 

dq2^  — 801  T  I201C2  T  402^2 

Since  S2  7^  0,  there  are  only  be  three  cases  that  can  give  d^hldq2^  (courage,  we  are  almost 
there!):  01  =  0,  02  +  C11C2  =  0,  and  01  •  (02  +  01C2)  7^  0. 


Zc  = 

Ki  = 

K2  = 
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B.6.2  Case  4.1:  C2  =  0,  S2  =  0,  and  ^1  =  0 

In  this  case,  2ai  — SaiCl — 0201  =  —a2C'2,  which  cannot  be  equal  to  zero.  This  implies  that 
the  expressions  for  Zc,Ki,,  and  K2  given  in  (B.16)  are  defined,  so  that  Zc  =  0,  ^^2  =  0, 
and  Ki  =  —02/^2,  from  which  we  deduce  that  Rc  —  («2  +  ^2)/M2|  and  q\  =  — Sgnd2  •7r/2. 
Then,  for  this  pose  of  the  observer  and  value  of  the  first  joint  angle,  h{  ■  ,ql)  is  the  null 
function. 


B.6.3  Case  4.2:  d2^0,  C2  =  0,  ^2  =  0,  and  fli  =  0,  and  ai+a2  -  €2  =  0 

Then  C2  =  —02/01  and  S2  =  e\J a\  —  a^/ai^  with  e  =  ±1.  Obviously  S2  and  C2  are 
defined  if  and  only  if  |ai|  >  02  and,  since  S2  ^  0,  we  cannot  have  |ai|  =  02-  We  are 
therefore  dealing  with  the  case  |ai|  >  ao,  and  then  2ai  -  ZaiCo  -  aoC^  =  (2af  -  02)  • 
(of  —  a2)la\^  which  cannot  be  equal  to  zero.  The  expressions  for  Zc.  K\^  and  K2  given  in 
(B.16)  are  therefore  defined  and  simplify  to 


—1ta\a2\j CLi  —  O2 

2aj  —  02 

Since  Zc  must  be  positive,  we  have  e  =  -Sgnoi,  so  that  sing^  =  -yOi  -  o^/loil.  These 
parameters  were  chosen  so  that  h  and  its  first  three  partial  derivatives  with  respect  to  92 
are  zero,  but  the  fourth  order  derivative  is  then  equal  to  ^a\a2l{2a\  -  O2),  which  cannot 
be  null. 


B.6.4  Case  4.3:  d2^0,  C2  =  0,  S2  =  0,  and  ai  =  0,  and  ai+a2  -  €2^0 

This  case  is  encountered  when  |oi|  <  02.  Then,  hxxx  =  d^h/dqo^  ^  0,  but  there  are  still 
an  infinity  of  configurations  Zc{q2),  Rc{q2),qi{q2),q2,  such  that  h  =  hx  =  hxx  =  0.  What 
we  observe  then  are  singular  branches  of  an  organizing  center  that  is  not  accessible  to  us. 
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